00000001:02000400:0.0F:1783947192.872040:0:3293:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1783947212.197115:0:3514:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1783947213.874637:0:3577:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 535 MB/s 00000001:01000000:3.0F:1783947214.125052:0:3577:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 715 MB/s 00000001:01000000:3.0:1783947214.374518:0:3577:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9875 MB/s 00000020:02000000:3.0:1783947215.162891:0:3606:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_g6041613 00000400:02000000:0.0:1783947216.084559:0:3621:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.204.103@tcp [8/256/0/180] 00008000:02000000:3.0:1783947220.730452:0:3771:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1783947281.650017:0:5737:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783947294.730896:0:6487:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783947294.730901:0:6487:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783947294.730902:0:6487:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783947294.731105:0:6487:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000005937304f 00000080:02000400:1.0:1783947294.731117:0:6487:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1783947294.742940:0:6487:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1783947294.742957:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783947294.743003:0:6487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002cd5e872) 00000020:00000080:1.0:1783947294.743030:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783947294.820666:0:6487:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783947294.820752:0:6487:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1783947294.866962:0:6487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783947294.867255:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783947294.867273:0:6487:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783947294.867288:0:6487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb554ffc37 00000020:01000004:3.0:1783947294.867296:0:6487:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783947294.867302:0:6487:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783947294.867307:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005937304f from MGS 00000020:01000004:3.0:1783947294.867311:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783947294.867334:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000080086bf9) 00000020:00000080:3.0:1783947294.867349:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783947294.867496:0:6487:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005937304f from MGS, refs=2 00080000:01000000:3.0:1783947294.867503:0:6487:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783947294.867509:0:6487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb554ffc45 00000100:00100000:3.0:1783947294.867613:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783947294.867764:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783947294.867771:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783947294.868993:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783947294.869002:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783947294.876606:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947294.876820:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783947294.876829:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783947294.881053:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783947294.881068:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783947294.881969:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783947294.881978:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783947294.883115:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947294.883120:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947294.883122:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947294.883808:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947294.883811:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947294.883813:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947294.884379:0:6487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783947294.890889:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1783947295.133540:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2939 MB/s 00000001:01000000:1.0:1783947295.383603:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3803 MB/s 00000001:01000000:2.0:1783947295.634392:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 631 MB/s 00000001:01000000:2.0:1783947295.886261:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 750 MB/s 00080000:10000000:2.0:1783947295.890977:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1783947295.917027:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:1.0:1783947295.924301:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783947295.924902:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783947295.924979:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783947295.925041:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1783947295.925276:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783947295.925305:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783947295.925820:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947295.925973:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783947295.925982:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783947295.929155:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783947295.929170:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783947295.929913:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783947295.929921:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783947295.930694:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783947295.930720:0:6487:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.103@tcp' 00000020:01000004:3.0:1783947295.930722:0:6487:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783947295.930776:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.103@tcp (typ=mgc) 00000020:00000080:3.0:1783947295.930790:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.103@tcp (0000000077e8db71) 00000020:00000080:3.0:1783947295.930807:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783947295.930891:0:6487:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000073ae45c4@MGC192.168.204.103@tcp: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947295.931056:0:6487:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.103@tcp-0 is initialized 00000040:01000000:3.0:1783947295.931065:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783947295.933721:0:6506:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783947295.936880:0:6507:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783947295.936986:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.103@tcp (uuid c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2) 00000020:00000080:3.0:1783947295.937012:0:6487:0:(genops.c:1406:class_connect()) connect: client c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2, cookie 0xe6fd1fdb554ffc53 00000100:00080000:3.0:1783947295.937025:0:6487:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947295.937031:0:6487:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import 0000000073ae45c4 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947295.937080:0:6487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001e082dff x1870604235964544/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947295.937113:0:6487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS 00000020:01000004:3.0:1783947295.937145:0:6487:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783947295.937152:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783947295.937167:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000bf5f7bf6) 00000020:00000080:3.0:1783947295.937180:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783947295.939323:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001e082dff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604235964544:0@lo:250: 00000100:00100000:1.0:1783947295.939426:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947295.944279:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235964544 00000100:00100000:0.0:1783947295.944295:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235964544 00000100:00100000:0.0:1783947295.947544:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947295.947557:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000141bdc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1870604235964544:12345-0@lo:250: 00010000:00080000:0.0:1783947295.947591:0:6503:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1783947295.947628:0:6503:0:(genops.c:1406:class_connect()) connect: client c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2, cookie 0xe6fd1fdb554ffc61 00000100:00080000:0.0:1783947295.947793:0:6503:0:(import.c:65:import_set_state_nolock()) 0000000064d66259 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947295.947902:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000141bdc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:3636:x1870604235964544:12345-0@lo:250: Request processed in 345us (8475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947295.947910:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947295.947923:0:3636:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783947295.947935:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.103@tcp: connect to target with instance 0 00000100:00080000:1.0:1783947295.947944:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783947295.947949:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783947295.947952:0:3636:0:(import.c:65:import_set_state_nolock()) 0000000073ae45c4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783947295.947955:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783947295.947968:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783947295.947974:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001e082dff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604235964544:0@lo:250: 00000100:00100000:3.0:1783947295.950763:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947295.950951:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783947295.950958:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783947295.953069:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947295.953086:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783947295.953833:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783947295.953842:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783947295.954986:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947295.955298:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783947295.955305:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783947295.961830:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783947295.961843:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783947296.019902:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947296.020235:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783947296.020253:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783947296.026965:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783947296.026992:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783947296.030980:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947296.031164:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783947296.031171:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783947296.032875:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783947296.032887:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783947296.034233:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947296.034600:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783947296.034605:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783947296.035406:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783947296.035416:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783947296.036849:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947296.037156:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783947296.037164:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783947296.038225:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783947296.038234:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783947296.064397:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947296.064755:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783947296.064763:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783947296.067230:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947296.067246:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783947296.069829:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783947296.069853:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783947296.073351:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783947296.073400:0:6487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783947296.073408:0:6487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783947296.073768:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947296.073823:0:6487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1783947296.073828:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947296.073830:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947296.073831:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947296.073833:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947296.073834:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947296.073835:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947296.073836:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947296.073838:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947296.073839:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947296.073841:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947296.073842:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947296.073844:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947296.073847:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1783947296.073850:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947296.073851:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947296.073852:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947296.073853:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947296.073854:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947296.073861:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947296.073862:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947296.073863:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947296.073863:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947296.073864:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947296.073865:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947296.073866:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947296.073919:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783947296.073943:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000005a2515e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235964672:0@lo:253: 00000100:00100000:1.0:1783947296.074049:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.074106:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a97a8420 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.074182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235964672 00000100:00100000:2.0:1783947296.074198:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235964672 00000100:00100000:2.0:1783947296.075994:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947296.076015:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ea8c207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:6487:x1870604235964672:12345-0@lo:253: 20000000:01000000:2.0:1783947296.076104:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783947296.076107:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1783947296.079793:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783947296.079872:0:6505:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783947296.080237:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947296.086163:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1783947296.086495:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783947296.086502:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1783947296.086508:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1783947296.086512:0:6505:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1783947296.086528:0:6505:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1783947296.086866:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947296.087081:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1783947296.087096:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783947296.087113:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1783947296.087131:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1783947296.087178:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1783947296.087256:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1783947296.087264:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1783947296.087277:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1783947296.087282:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1783947296.087294:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1783947296.087298:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1783947296.087310:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1783947296.087325:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1783947296.087351:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783947296.087355:0:6505:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1783947296.087362:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947296.087453:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1783947296.087488:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783947296.087503:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1783947296.087516:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1783947296.087529:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1783947296.087536:0:6505:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1783947296.087557:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1783947296.087563:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783947296.087573:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1783947296.087586:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1783947296.087598:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1783947296.087605:0:6505:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1783947296.087624:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1783947296.087629:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1783947296.087640:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1783947296.087664:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1783947296.087734:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1783947296.087755:0:6505:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783947296.087763:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1783947296.090675:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1783947296.091020:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1783947296.091055:0:6505:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.103@tcp for mdt 20000000:01000000:2.0:1783947296.091067:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:2.0:1783947296.091086:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1783947296.091094:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783947296.091109:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1783947296.091115:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:2.0:1783947296.091128:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1783947296.091136:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1783947296.091164:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1783947296.091182:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1783947296.091213:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783947296.091216:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783947296.091221:0:6505:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783947296.091292:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783947296.091296:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783947296.092503:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1783947296.092792:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1783947296.092824:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1783947296.092839:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1783947296.092850:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783947296.092853:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783947296.093829:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1783947296.094696:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1783947296.094733:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1783947296.094750:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1783947296.094764:0:6505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947296.094767:0:6505:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1783947296.094774:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783947296.094776:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783947296.094783:0:6505:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1783947296.094790:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1783947296.095847:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1783947296.096007:0:6505:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1783947296.119565:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1783947296.119614:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1783947296.119628:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1783947296.119655:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783947296.119693:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119729:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119740:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119746:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119753:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119760:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119766:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000026790c8 already unused, calling callback (0000000012aa3ab0) 00010000:00010000:3.0:1783947296.119770:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119778:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119791:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119799:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.119805:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000026790c8/0xe6fd1fdb554ffc68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947296.119837:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783947296.145994:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ea8c207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:6487:x1870604235964672:12345-0@lo:253: Request processed in 69974us (71932us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947296.146015:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947296.146156:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000005a2515e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235964672:0@lo:253: 10000000:01000000:2.0:1783947296.146174:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783947296.146178:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947296.146196:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783947296.146197:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947296.146199:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783947296.146200:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947296.146201:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947296.146203:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783947296.146204:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783947296.146205:0:6487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783947296.146207:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947296.146208:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783947296.146232:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005937304f from lustre-MDT0000 10000000:01000000:2.0:1783947296.146430:0:6487:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783947296.146434:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783947296.146439:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e7bc5510000 10000000:01000000:2.0:1783947296.146444:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947296.146453:0:6487:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e7bc5510000 from 1 10000000:01000000:2.0:1783947296.146594:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783947296.146661:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.147737:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.147767:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947296.147797:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b8c288c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235964800:0@lo:101: 00000100:00100000:2.0:1783947296.148131:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947296.148287:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000046ff4629 going to sleep for 11 seconds 00000100:00100000:0.0:1783947296.149616:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235964800 00000100:00100000:0.0:1783947296.149633:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235964800 00000100:00100000:0.0:1783947296.149784:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947296.149794:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe66523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:6487:x1870604235964800:12345-0@lo:101: 00010000:00010000:0.0:1783947296.149817:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947296.149856:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffc6f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947296.149888:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 6 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947296.149900:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 6 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947296.149909:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012f48e5a, rc 0) 00000100:00100000:0.0:1783947296.149998:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe66523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:6487:x1870604235964800:12345-0@lo:101: Request processed in 207us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947296.150006:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947296.150075:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b8c288c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235964800:0@lo:101: 00010000:00010000:1.0:1783947296.150095:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.150106:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947296.150195:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e51ddf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235964928:0@lo:501: 00000100:00100000:1.0:1783947296.150253:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.154965:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000085cb8dcf going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.157073:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235964928 00000100:00100000:2.0:1783947296.157092:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235964928 00000100:00100000:2.0:1783947296.157162:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947296.157172:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025874cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:6487:x1870604235964928:12345-0@lo:501: 00000100:00100000:2.0:1783947296.157403:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025874cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:6487:x1870604235964928:12345-0@lo:501: Request processed in 233us (7150us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947296.157412:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947296.157537:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e51ddf5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235964928:0@lo:501: 10000000:01000000:3.0:1783947296.157592:0:6487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783947296.157672:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.157682:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947296.157693:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7bc9511800 10000000:01000000:3.0:1783947296.157700:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783947296.157708:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e7bc9511800 10000000:01000000:3.0:1783947296.157711:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783947296.157714:0:6487:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e7bc9511800 from 1 10000000:01000000:3.0:1783947296.157717:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783947296.157756:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000026790c8/0xe6fd1fdb554ffc7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.157764:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000026790c8/0xe6fd1fdb554ffc7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.157773:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000026790c8/0xe6fd1fdb554ffc7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947296.157792:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965056:0@lo:101: 00000100:00100000:3.0:1783947296.157858:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947296.157892:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000099621ad6 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.158373:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965056 00000100:00100000:2.0:1783947296.158381:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965056 00000100:00100000:2.0:1783947296.158411:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947296.158417:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005543a29b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:6487:x1870604235965056:12345-0@lo:101: 00010000:00010000:2.0:1783947296.158429:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947296.158447:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095df4c32/0xe6fd1fdb554ffc84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffc7d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.158491:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095df4c32/0xe6fd1fdb554ffc84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc7d expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.158501:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095df4c32/0xe6fd1fdb554ffc84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc7d expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.158510:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095df4c32, rc 0) 00000100:00100000:2.0:1783947296.158602:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005543a29b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+7:6487:x1870604235965056:12345-0@lo:101: Request processed in 185us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.158609:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947296.158685:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965056:0@lo:101: 00010000:00010000:3.0:1783947296.158705:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000026790c8/0xe6fd1fdb554ffc7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.158714:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000026790c8/0xe6fd1fdb554ffc7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947296.158728:0:6487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783947296.158780:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000026790c8/0xe6fd1fdb554ffc7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.158787:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000026790c8/0xe6fd1fdb554ffc7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947296.158794:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783947296.158798:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783947296.158804:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e7bc9511800 10000000:01000000:3.0:1783947296.158806:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783947296.158809:0:6487:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783947296.158811:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783947296.158828:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.158834:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.158840:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947296.158853:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965184:0@lo:101: 00000100:00100000:3.0:1783947296.158881:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947296.158913:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000099621ad6 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.159040:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965184 00000100:00100000:2.0:1783947296.159045:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965184 00000100:00100000:2.0:1783947296.159067:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947296.159072:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020adb1d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+7:6487:x1870604235965184:12345-0@lo:101: 00010000:00010000:2.0:1783947296.159080:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947296.159089:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffc8b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.159116:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.159124:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.159130:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e430d537, rc 0) 00000100:00100000:2.0:1783947296.159545:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020adb1d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+8:6487:x1870604235965184:12345-0@lo:101: Request processed in 471us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.159553:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947296.159614:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965184:0@lo:101: 00010000:00010000:3.0:1783947296.159627:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.159634:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947296.159703:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965312:0@lo:501: 00000100:00100000:3.0:1783947296.159729:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947296.159795:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000099621ad6 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.159832:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965312 00000100:00100000:2.0:1783947296.159837:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965312 00000100:00100000:2.0:1783947296.159855:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947296.159860:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9af7383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+8:6487:x1870604235965312:12345-0@lo:501: 00000100:00100000:2.0:1783947296.160089:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9af7383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6487:x1870604235965312:12345-0@lo:501: Request processed in 227us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.160098:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947296.160239:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965312:0@lo:501: 00000100:00100000:3.0:1783947296.160270:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965440:0@lo:503: 00000100:00100000:3.0:1783947296.160319:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947296.160373:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000099621ad6 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.160411:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965440 00000100:00100000:2.0:1783947296.160416:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965440 00000100:00100000:2.0:1783947296.160435:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947296.160440:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bfcb4c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6487:x1870604235965440:12345-0@lo:503: 00000100:00100000:2.0:1783947296.160650:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bfcb4c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6487:x1870604235965440:12345-0@lo:503: Request processed in 209us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.160657:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947296.160732:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965440:0@lo:503: 00000100:00100000:2.0:1783947296.161552:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071cdaaee pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6532:1870604235965568:0@lo:502: 00000100:00100000:2.0:1783947296.161607:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947296.161694:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c55e51b3 going to sleep for 11 seconds 00000100:00100000:0.0:1783947296.161706:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965568 00000100:00100000:0.0:1783947296.161719:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965568 00000100:00100000:0.0:1783947296.161925:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947296.161933:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac143981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6532:x1870604235965568:12345-0@lo:502: 00000100:00100000:0.0:1783947296.162054:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac143981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6532:x1870604235965568:12345-0@lo:502: Request processed in 122us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947296.162063:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947296.162100:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071cdaaee pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6532:1870604235965568:0@lo:502: 00000020:01000000:2.0:1783947296.162130:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947296.162227:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947296.162235:0:6532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783947296.162241:0:6532:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783947296.162245:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947296.162271:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000534892a) 00000020:00000080:2.0:1783947296.162297:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783947296.162303:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783947296.162404:0:6532:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783947296.162412:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb554ffca0 00000020:00000080:2.0:1783947296.162890:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783947296.162895:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947296.162900:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947296.162901:0:6532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783947296.162904:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947296.162908:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947296.162909:0:6532:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783947296.162912:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947296.162919:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000052be91c0) 00000020:00000080:2.0:1783947296.162930:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783947296.162934:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783947296.162935:0:6532:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783947296.162938:0:6532:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783947296.162943:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947296.163005:0:6532:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005937304f from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783947296.163019:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004298a27f) 00000020:00000080:2.0:1783947296.163027:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783947296.163109:0:6532:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783947296.163115:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb554ffcb5 00000020:00000080:2.0:1783947296.163393:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783947296.163399:0:6532:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783947296.163410:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe6fd1fdb554ffcbc 00080000:01000000:2.0:1783947296.163415:0:6532:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783947296.163419:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb554ffcc3 00080000:10000000:2.0:1783947296.164049:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1783947296.164311:0:6532:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783947296.177412:0:6532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783947296.315784:0:6532:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783947296.317939:0:6532:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783947296.323604:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783947296.324017:0:6532:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783947296.329723:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000086287de7) 00000020:00000080:2.0:1783947296.329750:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783947296.329887:0:6532:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783947296.329903:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb554ffcd1 00000020:00000080:0.0:1783947296.333053:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1783947296.334186:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1783947296.338613:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1783947296.343722:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1783947296.353426:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1783947296.358209:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1783947296.363117:0:6532:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1783947296.365300:0:6532:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe6fd1fdb554ffcd8 00000020:00000080:0.0:1783947296.366051:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783947296.366067:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947296.366074:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947296.366077:0:6532:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783947296.366081:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947296.366085:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947296.366087:0:6532:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783947296.366090:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783947296.366092:0:6532:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783947296.366094:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947296.366097:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947296.366098:0:6532:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783947296.366099:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947296.366104:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947296.366105:0:6532:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783947296.366109:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783947296.366172:0:6532:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1783947296.366260:0:6532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fae037dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6532:1870604235965696:0@lo:502: 00000100:00100000:0.0:1783947296.366359:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947296.366419:0:6532:0:(client.c:2702:ptlrpc_set_wait()) set 0000000072a7823f going to sleep for 11 seconds 00000100:00100000:1.0:1783947296.366517:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965696 00000100:00100000:1.0:1783947296.366525:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965696 00000100:00100000:1.0:1783947296.366570:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947296.366580:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f597ae7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6532:x1870604235965696:12345-0@lo:502: 00000100:00100000:1.0:1783947296.366749:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f597ae7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6532:x1870604235965696:12345-0@lo:502: Request processed in 171us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947296.366757:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947296.366862:0:6532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fae037dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6532:1870604235965696:0@lo:502: 00000020:01000000:2.0:1783947296.366891:0:6532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947296.366896:0:6532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947296.366897:0:6532:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1783947296.366902:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783947296.367192:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783947296.367214:0:6487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783947296.367243:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.367253:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947296.367261:0:6487:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bc9511800 from 1 10000000:01000000:1.0:1783947296.367264:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947296.367300:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.367308:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.367316:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947296.367330:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b49176e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965824:0@lo:101: 00000100:00100000:1.0:1783947296.367363:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.367503:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f138a5a6 going to sleep for 11 seconds 00000100:00100000:0.0:1783947296.375480:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965824 00000100:00100000:0.0:1783947296.375530:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965824 00000100:00100000:0.0:1783947296.375599:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947296.375609:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000559dd322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:6487:x1870604235965824:12345-0@lo:101: 00010000:00010000:0.0:1783947296.375632:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947296.375656:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffcdf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947296.375700:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947296.375711:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947296.375721:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047637cfb, rc 0) 00000100:00100000:0.0:1783947296.375824:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000559dd322 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:6487:x1870604235965824:12345-0@lo:101: Request processed in 216us (8459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947296.375831:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947296.376061:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b49176e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965824:0@lo:101: 00010000:00010000:3.0:1783947296.376083:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.376093:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947296.376869:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965952:0@lo:256: 00000100:00100000:3.0:1783947296.376945:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947296.376998:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 00000000079d87d3 going to sleep for 11 seconds 00000100:00100000:0.0:1783947296.377081:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235965952 00000100:00100000:0.0:1783947296.377089:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235965952 00000100:00100000:0.0:1783947296.377135:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947296.377143:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f74a3c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:6487:x1870604235965952:12345-0@lo:256: 20000000:01000000:0.0:1783947296.377176:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783947296.377182:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1783947296.377269:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f74a3c29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:6487:x1870604235965952:12345-0@lo:256: Request processed in 127us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947296.377277:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947296.377416:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084a14091 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235965952:0@lo:256: 10000000:01000000:1.0:1783947296.378065:0:6487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947296.378088:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.378108:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947296.378117:0:6487:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc9511800 from 1 10000000:01000000:1.0:1783947296.378120:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947296.378170:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.378178:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.378188:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947296.378206:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966080:0@lo:101: 00000100:00100000:1.0:1783947296.378254:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.378292:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f138a5a6 going to sleep for 11 seconds 00000100:00100000:1.0:1783947296.378319:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966080 00000100:00100000:1.0:1783947296.378325:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966080 00000100:00100000:1.0:1783947296.378365:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947296.378372:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ae22a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:6487:x1870604235966080:12345-0@lo:101: 00010000:00010000:1.0:1783947296.378386:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947296.378404:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffced expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.378426:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.378434:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.378489:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011741f18, rc 0) 00000100:00100000:1.0:1783947296.378523:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ae22a82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:6487:x1870604235966080:12345-0@lo:101: Request processed in 151us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947296.378531:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947296.378576:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966080:0@lo:101: 00010000:00010000:1.0:1783947296.378590:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.378598:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947296.378684:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966208:0@lo:501: 00000100:00100000:1.0:1783947296.378710:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.378729:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0d3b68b going to sleep for 11 seconds 00000100:00100000:1.0:1783947296.378740:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966208 00000100:00100000:1.0:1783947296.378744:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966208 00000100:00100000:1.0:1783947296.378762:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947296.378767:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a688c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:6487:x1870604235966208:12345-0@lo:501: 00000100:00100000:1.0:1783947296.378966:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a688c6c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:6487:x1870604235966208:12345-0@lo:501: Request processed in 198us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947296.378974:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947296.379048:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966208:0@lo:501: 00000100:00100000:1.0:1783947296.379081:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966336:0@lo:503: 00000100:00100000:1.0:1783947296.379127:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.379140:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0d3b68b going to sleep for 11 seconds 00000100:00100000:1.0:1783947296.379159:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966336 00000100:00100000:1.0:1783947296.379163:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966336 00000100:00100000:1.0:1783947296.379181:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947296.379186:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a40ddaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:6487:x1870604235966336:12345-0@lo:503: 00000040:00080000:1.0:1783947296.379490:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947296.379530:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a40ddaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:6487:x1870604235966336:12345-0@lo:503: Request processed in 343us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947296.379536:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947296.379577:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966336:0@lo:503: 00000040:00080000:0.0:1783947296.386239:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1783947296.386505:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1783947296.386535:0:6487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947296.386554:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.386568:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947296.386632:0:6487:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783947296.386636:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7bc9511800 10000000:01000000:1.0:1783947296.386639:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7bc9511800 10000000:01000000:1.0:1783947296.386643:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947296.386649:0:6487:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc9511800 from 1 10000000:01000000:1.0:1783947296.386652:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947296.386708:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.386717:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.386729:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947296.386775:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966464:0@lo:101: 00000100:00100000:1.0:1783947296.387005:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.387076:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000077351bf2 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.387169:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966464 00000100:00100000:2.0:1783947296.387177:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966464 00000100:00100000:2.0:1783947296.387238:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947296.387247:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee086e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:6487:x1870604235966464:12345-0@lo:101: 00010000:00010000:2.0:1783947296.387265:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947296.387280:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffcfb expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.387306:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.387316:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.387332:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000790443f2, rc 0) 00000100:00100000:2.0:1783947296.387388:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee086e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6487:x1870604235966464:12345-0@lo:101: Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.387396:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783947296.387625:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966464:0@lo:101: 00010000:00010000:1.0:1783947296.387642:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.387652:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947296.387750:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966592:0@lo:501: 00000100:00100000:1.0:1783947296.387779:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.387919:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 0000000077351bf2 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.388005:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966592 00000100:00100000:2.0:1783947296.388011:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966592 00000100:00100000:2.0:1783947296.388050:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947296.388057:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008a65c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6487:x1870604235966592:12345-0@lo:501: 00000100:00100000:2.0:1783947296.388270:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008a65c1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6487:x1870604235966592:12345-0@lo:501: Request processed in 213us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.388277:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947296.388757:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c24851ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966592:0@lo:501: 00000100:00100000:0.0:1783947296.388978:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050ef6fd1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966720:0@lo:503: 00000100:00100000:0.0:1783947296.389038:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947296.389122:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 000000005c77b92c going to sleep for 11 seconds 00000100:00100000:3.0:1783947296.389266:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966720 00000100:00100000:3.0:1783947296.389272:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966720 00000100:00100000:3.0:1783947296.389377:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947296.389386:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055761f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6487:x1870604235966720:12345-0@lo:503: 00000100:00100000:3.0:1783947296.389551:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055761f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6487:x1870604235966720:12345-0@lo:503: Request processed in 167us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947296.389559:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947296.389656:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050ef6fd1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235966720:0@lo:503: 00000100:00100000:0.0:1783947296.390243:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050ef6fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6537:1870604235966848:0@lo:502: 00000100:00100000:0.0:1783947296.390290:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947296.390739:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 0000000078767a54 going to sleep for 11 seconds 00000100:00100000:2.0:1783947296.391350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966848 00000100:00100000:2.0:1783947296.391361:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966848 00000100:00100000:2.0:1783947296.391419:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947296.391489:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef3b4273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6537:x1870604235966848:12345-0@lo:502: 00000100:00100000:2.0:1783947296.391674:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef3b4273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6537:x1870604235966848:12345-0@lo:502: Request processed in 248us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.391682:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947296.391921:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050ef6fd1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6537:1870604235966848:0@lo:502: 00000020:01000004:0.0:1783947296.391998:0:6537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783947296.392031:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007f87192e) 00000020:00000080:0.0:1783947296.392056:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1783947296.392587:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005937304f from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783947296.392591:0:6537:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005937304f from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783947296.392594:0:6537:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005937304f 4 00010000:00080000:0.0:1783947296.392626:0:6537:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c533758d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947296.403328:0:6537:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783947296.403489:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783947296.403545:0:6537:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783947296.403562:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe6fd1fdb554ffd10 00000100:00080000:1.0:1783947296.403575:0:6537:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947296.403580:0:6537:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c533758d using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947296.403627:0:6537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000526772b1 x1870604235966976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947296.403670:0:6537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783947296.404036:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604235966976:0@lo:38: 00000100:00100000:3.0:1783947296.404129:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.404898:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235966976 00000100:00100000:1.0:1783947296.404911:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235966976 00000100:00100000:1.0:1783947296.404962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947296.404969:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094166842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1870604235966976:12345-0@lo:38: 00000100:00100000:1.0:1783947296.405054:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094166842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1870604235966976:12345-0@lo:38: Request processed in 85us (925us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783947296.405062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947296.405108:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947296.405115:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000c533758d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947296.405119:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783947296.405122:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604235966976:0@lo:38: 00000100:00100000:3.0:1783947296.406299:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e5d0418 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6537:1870604235967104:0@lo:502: 00000100:00100000:3.0:1783947296.406397:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947296.406484:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fc143dd9 going to sleep for 11 seconds 00000100:00100000:1.0:1783947296.406685:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235967104 00000100:00100000:1.0:1783947296.406694:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235967104 00000100:00100000:1.0:1783947296.406744:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947296.406752:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004ebfe4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6537:x1870604235967104:12345-0@lo:502: 00000100:00100000:1.0:1783947296.407519:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004ebfe4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6537:x1870604235967104:12345-0@lo:502: Request processed in 766us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947296.407528:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947296.407716:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e5d0418 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6537:1870604235967104:0@lo:502: 00000040:00080000:3.0:1783947296.407754:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1783947296.408485:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1783947296.408513:0:6487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947296.408531:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.408542:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783947296.408600:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783947296.408603:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947296.408604:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947296.408605:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947296.408606:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947296.408607:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947296.408609:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947296.408610:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947296.408616:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947296.408617:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947296.408619:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947296.408621:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783947296.408625:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1783947296.408628:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947296.408629:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947296.408629:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947296.408630:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947296.408631:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947296.408632:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947296.408632:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947296.408633:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947296.408634:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947296.408635:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947296.408635:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947296.408636:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783947296.408675:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783947296.408695:0:6487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235967232:0@lo:253: 00000100:00100000:1.0:1783947296.408751:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.408787:0:6487:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0d3b68b going to sleep for 11 seconds 00000100:00100000:3.0:1783947296.409365:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235967232 00000100:00100000:3.0:1783947296.409374:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235967232 00000100:00100000:3.0:1783947296.409430:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947296.409439:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe5d069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6487:x1870604235967232:12345-0@lo:253: 20000000:01000000:3.0:1783947296.409493:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783947296.409509:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783947296.422669:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783947296.422732:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783947296.423227:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe5d069 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6487:x1870604235967232:12345-0@lo:253: Request processed in 13774us (14460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947296.423246:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947296.423399:0:6487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6487:1870604235967232:0@lo:253: 10000000:01000000:1.0:1783947296.423416:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783947296.423420:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947296.423422:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947296.423423:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947296.423424:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947296.423425:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947296.423426:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947296.423427:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947296.423429:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947296.423430:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947296.423431:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947296.423433:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947296.423435:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783947296.423453:0:6487:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1783947296.427394:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783947296.427412:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783947296.428528:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.428558:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.428566:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.428641:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.428671:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 11 pid: 6504 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947296.428687:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071cdaaee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235967360:0@lo:104: 00000100:00100000:2.0:1783947296.428767:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947296.428835:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057429241 going to sleep for 11 seconds 00000100:00100000:1.0:1783947296.428994:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235967360 00000100:00100000:1.0:1783947296.429009:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235967360 00000100:00100000:1.0:1783947296.429066:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947296.429074:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006999a9e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604235967360:12345-0@lo:104: 00010000:00010000:1.0:1783947296.429088:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.429156:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947296.429161:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006999a9e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604235967360:12345-0@lo:104: Request processed in 89us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947296.429169:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783947296.429193:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947296.429198:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.429205:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060b02520 already unused, calling callback (0000000061d09b67) 10000000:00010000:1.0:1783947296.429209:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.429216:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947296.429222:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947296.429227:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947296.429258:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.429264:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947296.429280:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.429295:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 0000000060b02520/0xe6fd1fdb554ffcdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffce6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947296.429313:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947296.429315:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947296.429316:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947296.429391:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235967488:0@lo:103: 00000100:00100000:1.0:1783947296.429421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947296.429559:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071cdaaee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235967360:0@lo:104: 00010000:00010000:1.0:1783947296.429582:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947296.430164:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235967488 00000100:00100000:2.0:1783947296.430172:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235967488 00010000:00010000:2.0:1783947296.430198:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 12 pid: 6504 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947296.430225:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947296.430232:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ce1fed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:3638:x1870604235967488:12345-0@lo:103: 00010000:00010000:2.0:1783947296.430244:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947296.430249:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 12 pid: 6504 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430259:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 12 pid: 6504 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430273:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047637cfb/0xe6fd1fdb554ffce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcdf expref: 12 pid: 6504 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430288:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430308:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783947296.430322:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002911906s 00010000:00010000:2.0:1783947296.430327:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430332:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430337:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430341:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430346:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a84e855 already unused, calling callback (0000000012aa3ab0) 00010000:00010000:2.0:1783947296.430349:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430354:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430365:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947296.430374:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947296.430423:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ce1fed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:3638:x1870604235967488:12345-0@lo:103: Request processed in 193us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947296.430430:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947296.430496:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235967488:0@lo:103: 00010000:00010000:3.0:1783947296.431525:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.431550:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947296.431556:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1783947296.433783:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1783947296.434001:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1783947296.434221:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1783947296.434396:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1783947296.434628:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1783947296.434796:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1783947296.437614:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1783947296.437900:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1783947296.438234:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1783947296.438397:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1783947296.438912:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1783947296.439275:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1783947296.449286:0:6487:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1783947296.459952:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783947296.460239:0:6542:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783947296.460243:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1783947296.460362:0:6543:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783947296.465438:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783947296.468443:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783947296.469048:0:6487:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783947296.469068:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783947296.470040:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947296.470980:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947296.471977:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783947296.472763:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783947296.472963:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783947296.476481:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783947296.477881:0:6487:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:2.0:1783947296.480428:0:6543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783947296.480541:0:6543:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783947296.480546:0:6543:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1783947296.481733:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1783947296.484367:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1783947296.484740:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1783947296.484963:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1783947296.485105:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1783947296.485353:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1783947296.485754:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1783947296.485975:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1783947296.486114:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1783947296.486338:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1783947296.486582:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1783947296.486739:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1783947296.486952:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1783947296.487103:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1783947296.487335:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1783947296.487574:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1783947296.488078:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1783947296.488303:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1783947296.488435:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1783947296.488696:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1783947296.488901:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1783947296.489047:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1783947296.489236:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1783947296.489376:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783947296.490010:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783947296.490250:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783947296.490396:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783947296.490753:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783947296.490970:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783947296.491126:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783947296.491362:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783947296.491752:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783947296.492049:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1783947296.496410:0:6487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783947296.496481:0:6487:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb794819ef988 00100000:10000000:0.0:1783947296.496492:0:6487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783947296.497337:0:6487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783947296.497362:0:6487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783947296.497922:0:6487:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783947296.497961:0:6487:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783947296.498936:0:6487:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947296.499173:0:6487:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1783947296.950176:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947297.980238:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947298.998623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947300.021797:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947300.913584:0:6788:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783947301.046096:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947301.619727:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783947301.619740:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783947301.619743:0:469:0:(import.c:65:import_set_state_nolock()) 00000000c533758d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947301.619758:0:469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c533758d using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947301.619781:0:469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000903fb806 x1870604235967744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947301.619897:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000903fb806 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604235967744:0@lo:38: 00000100:00100000:3.0:1783947301.619974:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947301.620300:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947301.620309:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a2542b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235967616:0@lo:400: 00000100:00100000:1.0:1783947301.620359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947301.620686:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235967744 00000100:00100000:2.0:1783947301.620695:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235967744 00000100:00100000:2.0:1783947301.620736:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947301.620742:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e5d0418 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604235967744:12345-0@lo:38: 00010000:00080000:2.0:1783947301.620772:0:6512:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1783947301.620814:0:6512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe6fd1fdb554ffd1e 00000004:00100000:2.0:1783947301.620858:0:6512:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783947301.620975:0:6512:0:(import.c:65:import_set_state_nolock()) 000000004ffe319e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947301.621050:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e5d0418 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870604235967744:12345-0@lo:38: Request processed in 306us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947301.621066:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783947301.621299:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000903fb806 x1870604235967744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947301.621319:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783947301.621327:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783947301.621336:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783947301.621339:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000c533758d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947301.621345:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000903fb806 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604235967744:0@lo:38: 00000100:00100000:3.0:1783947301.621418:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235967616 00000100:00100000:3.0:1783947301.621424:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235967616 00000100:00100000:3.0:1783947301.621526:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947301.621533:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000724d1e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:3640:x1870604235967616:12345-0@lo:400: 00000100:00100000:3.0:1783947301.621594:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000724d1e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:3640:x1870604235967616:12345-0@lo:400: Request processed in 63us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947301.621601:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947301.621671:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a2542b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235967616:0@lo:400: 00000020:00000004:0.0:1783947301.796252:0:6840:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947301.796570:0:6840:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783947302.067953:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947303.091726:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947304.115772:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783947304.663984:0:6942:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947304.664146:0:6942:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783947305.139669:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947306.164060:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783947306.227614:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947306.227624:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bc9511800 from 3 10000000:01000000:1.0:1783947306.227629:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947306.227682:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947306.227696:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947306.227707:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947306.227735:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e0f5f8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235967872:0@lo:101: 00000100:00100000:1.0:1783947306.227822:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947306.227881:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d3f018e8 going to sleep for 11 seconds 00000100:00100000:0.0:1783947306.227884:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235967872 00000100:00100000:0.0:1783947306.227893:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235967872 00000100:00100000:0.0:1783947306.227949:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947306.227958:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c03f278a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:6507:x1870604235967872:12345-0@lo:101: 00010000:00010000:0.0:1783947306.227976:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947306.227991:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffd25 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947306.228014:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947306.228025:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947306.228035:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000379db0ca, rc 0) 00000100:00100000:0.0:1783947306.228085:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c03f278a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6507:x1870604235967872:12345-0@lo:101: Request processed in 128us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947306.228092:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947306.228118:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e0f5f8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235967872:0@lo:101: 00010000:00010000:2.0:1783947306.228133:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947306.228142:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947306.228199:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000579abef6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235968000:0@lo:256: 00000100:00100000:2.0:1783947306.228231:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947306.228254:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e03f1ef9 going to sleep for 11 seconds 00000100:00100000:0.0:1783947306.228296:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968000 00000100:00100000:0.0:1783947306.228345:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968000 00000100:00100000:0.0:1783947306.228376:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947306.228382:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aea06f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6507:x1870604235968000:12345-0@lo:256: 20000000:01000000:0.0:1783947306.228397:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783947306.228413:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783947306.228416:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1783947306.228530:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aea06f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:6507:x1870604235968000:12345-0@lo:256: Request processed in 148us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947306.228537:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947306.228610:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000579abef6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235968000:0@lo:256: 10000000:01000000:2.0:1783947306.228786:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947306.228793:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947306.228801:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947306.739785:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947306.739834:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000579abef6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604235968128:0@lo:400: 00000100:00100000:0.0:1783947306.739941:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947306.740051:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968128 00000100:00100000:3.0:1783947306.740060:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968128 00000100:00100000:3.0:1783947306.740117:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947306.740127:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050ef6fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604235968128:12345-0@lo:400: 00000100:00100000:3.0:1783947306.740199:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050ef6fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604235968128:12345-0@lo:400: Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947306.740207:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783947306.740367:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000579abef6 x1870604235968128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947306.740384:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000579abef6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604235968128:0@lo:400: 00010000:00010000:2.0:1783947307.188271:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947308.213707:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947309.235678:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947310.259713:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947311.290962:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947311.862600:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c78079b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604235968384:0@lo:400: 00000100:00100000:1.0:1783947311.862687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947311.862750:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968384 00000100:00100000:3.0:1783947311.862759:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968384 00000100:00100000:1.0:1783947311.862773:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947311.862781:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058d28dd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235968256:0@lo:400: 00000100:00100000:3.0:1783947311.862814:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947311.862823:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000177145f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604235968384:12345-0@lo:400: 00000100:00100000:3.0:1783947311.862897:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000177145f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604235968384:12345-0@lo:400: Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947311.862904:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947311.863508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947311.863564:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968256 00000100:00100000:3.0:1783947311.863569:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968256 00010000:00080000:1.0:1783947311.863646:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003c78079b x1870604235968384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947311.863657:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947311.863667:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000332d3b9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:3638:x1870604235968256:12345-0@lo:400: 00000100:00100000:1.0:1783947311.863689:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c78079b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604235968384:0@lo:400: 00000100:00100000:3.0:1783947311.863732:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000332d3b9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:3638:x1870604235968256:12345-0@lo:400: Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947311.863741:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058d28dd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235968256:0@lo:400: 00000100:00100000:3.0:1783947311.863743:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1783947312.307597:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947313.339019:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783947313.743513:0:7440:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783947313.743517:0:7440:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783947313.743519:0:7440:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783947313.743637:0:7440:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000062976cc1 00000020:01000004:0.0:1783947313.743669:0:7440:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1783947313.743681:0:7440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783947313.743696:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000008c2153bd) 00000020:00000080:0.0:1783947313.744009:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783947313.778069:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1783947313.778204:0:7440:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1783947313.816484:0:7440:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783947313.816715:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1783947313.816726:0:7440:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783947313.816739:0:7440:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb554ffd3a 00000020:01000004:1.0:1783947313.816747:0:7440:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783947313.816771:0:7440:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783947313.816774:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783947313.816782:0:7440:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1783947313.817000:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1783947313.817005:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1783947313.832740:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947313.832781:0:7440:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1783947313.832786:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947313.832789:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783947313.832790:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947313.832791:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947313.832792:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947313.832794:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947313.832796:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947313.832797:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947313.832799:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947313.832800:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947313.832801:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947313.832805:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1783947313.832808:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947313.832883:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783947313.832884:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947313.832885:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947313.832891:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947313.832892:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947313.832893:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947313.832893:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947313.832894:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947313.832895:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947313.832896:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947313.832926:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1783947313.832948:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058d28dd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235968512:0@lo:253: 00000100:00100000:1.0:1783947313.833023:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947313.833136:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af89a9a4 going to sleep for 11 seconds 00000100:00100000:0.0:1783947313.833286:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968512 00000100:00100000:0.0:1783947313.833295:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968512 00000100:00100000:0.0:1783947313.833401:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947313.833411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000996e6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:7440:x1870604235968512:12345-0@lo:253: 20000000:01000000:0.0:1783947313.833478:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783947313.833484:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1783947313.833488:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1783947313.833491:0:6505:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1783947313.833529:0:6505:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1783947313.833725:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947313.834082:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1783947313.834105:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783947313.834124:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1783947313.834138:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1783947313.834151:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1783947313.834203:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1783947313.834210:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1783947313.834229:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1783947313.834235:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1783947313.834248:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1783947313.834252:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1783947313.834266:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1783947313.834281:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1783947313.834411:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1783947313.834421:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:0.0:1783947313.834440:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1783947313.834446:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783947313.834535:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1783947313.834544:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:0.0:1783947313.834559:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1783947313.834565:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783947313.834576:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1783947313.834591:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1783947313.834601:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783947313.834680:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1783947313.834689:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1783947313.834716:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1783947313.834735:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1783947313.834751:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1783947313.834757:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1783947313.834769:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1783947313.834787:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1783947313.834792:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1783947313.834889:0:6505:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783947313.834898:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1783947313.835351:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783947313.835621:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1783947313.835640:0:6505:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.103@tcp for mdt 20000000:01000000:0.0:1783947313.835649:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:0.0:1783947313.835665:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1783947313.835670:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783947313.835683:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1783947313.835688:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:0.0:1783947313.835703:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1783947313.835710:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1783947313.835721:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1783947313.835736:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1783947313.835780:0:6505:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1783947313.835788:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1783947313.836199:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1783947313.836358:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783947313.836374:0:6505:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.204.103@tcp for mdt 20000000:01000000:0.0:1783947313.836376:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:0.0:1783947313.836390:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783947313.836396:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783947313.836408:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783947313.836413:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:0.0:1783947313.836425:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783947313.836431:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1783947313.836444:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783947313.836665:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1783947313.836686:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783947313.836689:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783947313.836694:0:6505:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783947313.836737:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783947313.836739:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783947313.837080:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1783947313.837180:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1783947313.837201:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783947313.837363:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1783947313.837380:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1783947313.837392:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1783947313.837399:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783947313.837405:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783947313.837997:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783947313.838019:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783947313.838030:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1783947313.838244:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1783947313.838264:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1783947313.838287:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1783947313.838297:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783947313.838298:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783947313.838669:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783947313.838687:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783947313.838700:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1783947313.838922:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783947313.838942:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783947313.838958:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1783947313.838969:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783947313.838971:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783947313.838976:0:6505:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783947313.838983:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783947313.839294:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1783947313.839407:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783947313.848257:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783947313.848365:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.848385:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.848392:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.848398:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.848404:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.848449:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.848976:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 12 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947313.848993:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c78079b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235968640:0@lo:104: 00000100:00100000:1.0:1783947313.849070:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947313.849176:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968640 00000100:00100000:0.0:1783947313.849184:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968640 00000100:00100000:0.0:1783947313.849226:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947313.849232:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c699b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235968640:12345-0@lo:104: 00010000:00010000:0.0:1783947313.849246:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.849289:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947313.849294:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c699b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235968640:12345-0@lo:104: Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947313.849301:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1783947313.849368:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947313.849373:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.849380:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ffcbf067 already unused, calling callback (0000000061d09b67) 10000000:00010000:2.0:1783947313.849383:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.849391:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947313.849397:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947313.849402:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947313.849439:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.849445:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947313.849509:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.849516:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffcfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd02 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.849525:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947313.849527:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947313.849528:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947313.849547:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235968768:0@lo:103: 00000100:00100000:2.0:1783947313.849579:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947313.849683:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849691:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 12 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947313.849699:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1256dde pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235968896:0@lo:104: 00000100:00100000:1.0:1783947313.849721:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947313.849740:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968896 00000100:00100000:1.0:1783947313.849744:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968896 00000100:00100000:1.0:1783947313.849768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947313.849773:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040f3a0e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235968896:12345-0@lo:104: 00010000:00010000:1.0:1783947313.849780:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849824:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947313.849829:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040f3a0e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235968896:12345-0@lo:104: Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947313.849834:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1783947313.849849:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947313.849853:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849858:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b26a39f already unused, calling callback (0000000061d09b67) 10000000:00010000:1.0:1783947313.849860:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849866:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947313.849877:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947313.849882:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947313.849896:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849902:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947313.849907:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849913:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 000000002b26a39f/0xe6fd1fdb554ffc8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffc92 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849922:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947313.849924:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947313.849925:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947313.849941:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.849948:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 12 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947313.849955:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235969152:0@lo:104: 00000100:00100000:1.0:1783947313.849976:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947313.849993:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969152 00000100:00100000:1.0:1783947313.849997:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969152 00000100:00100000:1.0:1783947313.850014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947313.850019:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051024983 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235969152:12345-0@lo:104: 00010000:00010000:1.0:1783947313.850031:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.850061:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947313.850066:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051024983 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235969152:12345-0@lo:104: Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947313.850072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947313.850090:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set 00000000072bc34a going to sleep for 11 seconds 00000100:00100000:1.0:1783947313.850123:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c78079b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235968640:0@lo:104: 00000100:00100000:1.0:1783947313.850132:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1256dde pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235968896:0@lo:104: 00000100:00100000:1.0:1783947313.850138:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235969152:0@lo:104: 00010000:00010000:1.0:1783947313.850159:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947313.850496:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235968768 00000100:00100000:0.0:1783947313.850501:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235968768 00010000:00010000:0.0:1783947313.850518:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 13 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947313.850547:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947313.850552:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007699ac8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:3639:x1870604235968768:12345-0@lo:103: 00010000:00010000:0.0:1783947313.850562:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947313.850567:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 13 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850575:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 13 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850590:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000790443f2/0xe6fd1fdb554ffd02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffcfb expref: 13 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850604:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947313.850629:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007699ac8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:3639:x1870604235968768:12345-0@lo:103: Request processed in 77us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947313.850635:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947313.850655:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235969024:0@lo:103: 00000100:00100000:0.0:1783947313.850680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947313.850714:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947313.850718:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850725:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001167d0a8 already unused, calling callback (0000000061d09b67) 10000000:00010000:0.0:1783947313.850727:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850734:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947313.850745:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947313.850751:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947313.850773:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850779:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947313.850791:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850797:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 000000001167d0a8/0xe6fd1fdb554ffc6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffc76 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850827:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947313.850829:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947313.850830:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947313.850839:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c047079a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235969280:0@lo:103: 00000100:00100000:0.0:1783947313.850862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947313.850889:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969024 00000100:00100000:0.0:1783947313.850892:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969024 00010000:00010000:0.0:1783947313.850904:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 12 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947313.850917:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969280 00000100:00100000:0.0:1783947313.850920:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969280 00010000:00010000:0.0:1783947313.850928:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 13 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947313.850939:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947313.850949:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fc15623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:3640:x1870604235969024:12345-0@lo:103: 00010000:00010000:0.0:1783947313.850957:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947313.850961:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 13 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850967:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 13 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850977:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e430d537/0xe6fd1fdb554ffc92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc8b expref: 13 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.850986:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947313.851009:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fc15623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:3640:x1870604235969024:12345-0@lo:103: Request processed in 60us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947313.851014:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947313.851027:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947313.851032:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee9ddd2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:3637:x1870604235969280:12345-0@lo:103: 00010000:00010000:0.0:1783947313.851039:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947313.851042:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 11 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851050:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 11 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851059:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffc76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffc6f expref: 11 pid: 6503 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851069:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851087:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851109:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851115:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851121:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851127:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851132:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f516cda7 already unused, calling callback (0000000012aa3ab0) 00010000:00010000:0.0:1783947313.851136:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851143:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851154:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.851162:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947313.851187:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee9ddd2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:3637:x1870604235969280:12345-0@lo:103: Request processed in 155us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947313.851194:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947313.851221:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c047079a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235969280:0@lo:103: 00000100:00100000:0.0:1783947313.851251:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235969024:0@lo:103: 00000100:00100000:2.0:1783947313.855007:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235968768:0@lo:103: 00010000:00010000:1.0:1783947313.855276:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.855288:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.855296:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffd41 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783947313.855319:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1783947313.857862:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000996e6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:7440:x1870604235968512:12345-0@lo:253: Request processed in 24445us (24830us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.857881:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947313.858031:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058d28dd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235968512:0@lo:253: 10000000:01000000:1.0:1783947313.858047:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783947313.858051:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947313.858053:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783947313.858065:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947313.858066:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1783947313.858067:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947313.858068:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947313.858070:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947313.858071:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783947313.858073:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947313.858075:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947313.858096:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000062976cc1 from lustre-MDT0001 10000000:01000000:1.0:1783947313.858140:0:7440:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1783947313.858143:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783947313.858150:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7bc5510000 local copy 10000000:01000000:1.0:1783947313.858155:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947313.858195:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.858205:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.858214:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947313.858235:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058d28dd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969408:0@lo:101: 00000100:00100000:1.0:1783947313.858271:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947313.858355:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 000000001fb9a577 going to sleep for 11 seconds 00000100:00100000:0.0:1783947313.858420:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969408 00000100:00100000:0.0:1783947313.858428:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969408 00000100:00100000:0.0:1783947313.858502:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947313.858511:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009860d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:7440:x1870604235969408:12345-0@lo:101: 00010000:00010000:0.0:1783947313.858526:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947313.858540:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e2209c4/0xe6fd1fdb554ffd4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffd48 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.858577:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e2209c4/0xe6fd1fdb554ffd4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd48 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.858589:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e2209c4/0xe6fd1fdb554ffd4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd48 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.858601:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e2209c4, rc 0) 00000100:00100000:0.0:1783947313.858639:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009860d5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:7440:x1870604235969408:12345-0@lo:101: Request processed in 130us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947313.858645:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947313.858760:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058d28dd4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969408:0@lo:101: 00010000:00010000:2.0:1783947313.858772:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.858781:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947313.858884:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969536:0@lo:501: 00000100:00100000:2.0:1783947313.858911:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.858959:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 00000000600bb22c going to sleep for 11 seconds 00000100:00100000:1.0:1783947313.859243:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969536 00000100:00100000:1.0:1783947313.859248:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969536 00000100:00100000:1.0:1783947313.859281:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783947313.859287:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ed36290 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:7440:x1870604235969536:12345-0@lo:501: 00000100:00100000:1.0:1783947313.859368:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ed36290 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:7440:x1870604235969536:12345-0@lo:501: Request processed in 81us (457us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947313.859375:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947313.859444:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969536:0@lo:501: 10000000:01000000:2.0:1783947313.859483:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783947313.859501:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783947313.859506:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.859514:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.859521:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.859548:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783947313.859576:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7be784d800 10000000:01000000:2.0:1783947313.859580:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783947313.859585:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e7bc5510000 10000000:01000000:2.0:1783947313.859588:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783947313.859590:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e7bc5510000 from 1 10000000:01000000:2.0:1783947313.859593:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783947313.859612:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000003419f5a6/0xe6fd1fdb554ffd56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.859619:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000003419f5a6/0xe6fd1fdb554ffd56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.859627:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000003419f5a6/0xe6fd1fdb554ffd56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947313.859640:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969664:0@lo:101: 00000100:00100000:2.0:1783947313.859666:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.859687:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086003e60 going to sleep for 11 seconds 00000100:00100000:0.0:1783947313.859756:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969664 00000100:00100000:0.0:1783947313.859760:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969664 00000100:00100000:0.0:1783947313.859788:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947313.859794:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca42aa23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+10:7440:x1870604235969664:12345-0@lo:101: 00010000:00010000:0.0:1783947313.859801:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947313.859906:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffd5d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffd56 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.859924:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffd5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd56 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.859940:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012f48e5a/0xe6fd1fdb554ffd5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd56 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.859948:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012f48e5a, rc 0) 00000100:00100000:0.0:1783947313.859985:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca42aa23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:7440:x1870604235969664:12345-0@lo:101: Request processed in 191us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947313.859991:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947313.860066:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969664:0@lo:101: 00010000:00010000:2.0:1783947313.860077:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000003419f5a6/0xe6fd1fdb554ffd56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd5d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860085:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000003419f5a6/0xe6fd1fdb554ffd56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffd5d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947313.860108:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783947313.860121:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000003419f5a6/0xe6fd1fdb554ffd56 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd5d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860133:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000003419f5a6/0xe6fd1fdb554ffd56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd5d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947313.860141:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e7be784d800 10000000:01000000:2.0:1783947313.860144:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783947313.860146:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e7be784d800 from 1 10000000:01000000:2.0:1783947313.860148:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783947313.860161:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e430d537/0xe6fd1fdb554ffd64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860167:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000e430d537/0xe6fd1fdb554ffd64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860172:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000e430d537/0xe6fd1fdb554ffd64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947313.860183:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969792:0@lo:101: 00000100:00100000:2.0:1783947313.860209:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.860224:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086003e60 going to sleep for 11 seconds 00000100:00100000:2.0:1783947313.860237:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969792 00000100:00100000:2.0:1783947313.860240:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969792 00000100:00100000:2.0:1783947313.860268:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947313.860275:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb60091 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+11:7440:x1870604235969792:12345-0@lo:101: 00010000:00010000:2.0:1783947313.860282:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947313.860289:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001167d0a8/0xe6fd1fdb554ffd6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffd64 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860301:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001167d0a8/0xe6fd1fdb554ffd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd64 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860315:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001167d0a8/0xe6fd1fdb554ffd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd64 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860321:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001167d0a8, rc 0) 00000100:00100000:2.0:1783947313.860361:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb60091 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:7440:x1870604235969792:12345-0@lo:101: Request processed in 87us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.860366:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947313.860397:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969792:0@lo:101: 00010000:00010000:2.0:1783947313.860406:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000e430d537/0xe6fd1fdb554ffd64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860413:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000e430d537/0xe6fd1fdb554ffd64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947313.860422:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783947313.860425:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000e430d537/0xe6fd1fdb554ffd64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860431:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000e430d537/0xe6fd1fdb554ffd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947313.860437:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783947313.860441:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947313.860445:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e7be784d800 10000000:01000000:2.0:1783947313.860447:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783947313.860450:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783947313.860451:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783947313.860484:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000790443f2/0xe6fd1fdb554ffd72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860496:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000790443f2/0xe6fd1fdb554ffd72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860503:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000790443f2/0xe6fd1fdb554ffd72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947313.860514:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969920:0@lo:101: 00000100:00100000:2.0:1783947313.860537:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.860555:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235969920 00000100:00100000:2.0:1783947313.860559:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235969920 00000100:00100000:2.0:1783947313.860580:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947313.860586:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7c3380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:7440:x1870604235969920:12345-0@lo:101: 00010000:00010000:2.0:1783947313.860593:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947313.860600:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffd72 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860612:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860619:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a84e855/0xe6fd1fdb554ffd79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860625:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a84e855, rc 0) 00000100:00100000:2.0:1783947313.860646:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7c3380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235969920:12345-0@lo:101: Request processed in 61us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.860652:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947313.860674:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086003e60 going to sleep for 11 seconds 00000100:00100000:2.0:1783947313.860685:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235969920:0@lo:101: 00010000:00010000:2.0:1783947313.860702:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000790443f2/0xe6fd1fdb554ffd72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947313.860710:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000790443f2/0xe6fd1fdb554ffd72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947313.860773:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970048:0@lo:501: 00000100:00100000:2.0:1783947313.860797:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.860965:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970048 00000100:00100000:2.0:1783947313.860970:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970048 00000100:00100000:2.0:1783947313.860992:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947313.860998:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022740970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235970048:12345-0@lo:501: 00000100:00100000:2.0:1783947313.861091:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022740970 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235970048:12345-0@lo:501: Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.861107:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947313.861131:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086003e60 going to sleep for 11 seconds 00000100:00100000:2.0:1783947313.861142:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970048:0@lo:501: 00000100:00100000:2.0:1783947313.861171:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970176:0@lo:503: 00000100:00100000:2.0:1783947313.861209:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.861227:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970176 00000100:00100000:2.0:1783947313.861230:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970176 00000100:00100000:2.0:1783947313.861249:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947313.861254:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007983a917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235970176:12345-0@lo:503: 00000100:00100000:2.0:1783947313.861335:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007983a917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235970176:12345-0@lo:503: Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.861342:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947313.861378:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086003e60 going to sleep for 11 seconds 00000100:00100000:2.0:1783947313.861389:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970176:0@lo:503: 00000040:00080000:2.0:1783947313.861671:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947313.861741:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970304:0@lo:502: 00000100:00100000:2.0:1783947313.861772:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.861795:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970304 00000100:00100000:2.0:1783947313.861799:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970304 00010000:00010000:1.0:1783947313.862152:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947313.862159:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.862169:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b92b3749 already unused, calling callback (0000000061d09b67) 10000000:00010000:1.0:1783947313.862172:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.862181:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947313.862188:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947313.862194:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947313.862216:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.862223:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947313.862240:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.862247:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffd48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554ffd4f expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947313.862259:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947313.862260:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947313.862262:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947313.862295:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947313.862304:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ba82b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235970304:12345-0@lo:502: 00000100:00100000:2.0:1783947313.862405:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ba82b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235970304:12345-0@lo:502: Request processed in 103us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.862412:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947313.862725:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235970432:0@lo:103: 00000100:00100000:1.0:1783947313.862758:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947313.862926:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970432 00000100:00100000:0.0:1783947313.862933:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970432 00000100:00100000:0.0:1783947313.862976:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947313.862983:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1256dde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:3638:x1870604235970432:12345-0@lo:103: 00010000:00010000:0.0:1783947313.862993:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947313.863010:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009e2209c4/0xe6fd1fdb554ffd4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd48 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.863023:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947313.863049:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1256dde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:3638:x1870604235970432:12345-0@lo:103: Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947313.863056:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947313.863186:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235970432:0@lo:103: 00000100:00100000:2.0:1783947313.863248:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086003e60 going to sleep for 11 seconds 00000100:00100000:2.0:1783947313.863262:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970304:0@lo:502: 00000040:00080000:2.0:1783947313.863764:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783947313.863797:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1783947313.863893:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1783947313.863913:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1783947313.863927:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1783947313.863940:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1783947313.863952:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1783947313.863964:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1783947313.863975:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1783947313.863990:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1783947313.864005:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1783947313.864016:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1783947313.864027:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1783947313.864038:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1783947313.864050:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1783947313.864074:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1783947313.864088:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1783947313.864148:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1783947313.864166:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1783947313.864180:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1783947313.864193:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1783947313.864207:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1783947313.864219:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1783947313.864258:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970560:0@lo:502: 00000100:00100000:2.0:1783947313.864310:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947313.864395:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086003e60 going to sleep for 11 seconds 00000100:00100000:0.0:1783947313.864450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970560 00000100:00100000:0.0:1783947313.864603:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970560 00000100:00100000:0.0:1783947313.864676:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947313.864684:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4a536a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:7440:x1870604235970560:12345-0@lo:502: 00000100:00100000:0.0:1783947313.864802:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4a536a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:7440:x1870604235970560:12345-0@lo:502: Request processed in 119us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.864913:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970560:0@lo:502: 00000040:00080000:2.0:1783947313.864959:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1783947313.864967:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00100000:0.0:1783947313.865219:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000020:01000000:2.0:1783947313.865562:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947313.865574:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947313.865577:0:7452:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783947313.865582:0:7452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1783947313.865586:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947313.865611:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000006dfef822) 00000020:00000080:2.0:1783947313.865634:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1783947313.865641:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783947313.865730:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947313.865740:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb554ffd87 00000020:00000080:2.0:1783947313.865981:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1783947313.865987:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947313.865990:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947313.865992:0:7452:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1783947313.865995:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947313.865998:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947313.865999:0:7452:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1783947313.866010:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947313.866016:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000006671c112) 00000020:00000080:2.0:1783947313.866026:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1783947313.866030:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783947313.866032:0:7452:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1783947313.866035:0:7452:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1783947313.866040:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947313.866081:0:7452:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000062976cc1 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1783947313.866093:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000003921f8e) 00000020:00000080:2.0:1783947313.866369:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1783947313.866444:0:7452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783947313.866452:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb554ffd9c 00000020:00000080:2.0:1783947313.866607:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1783947313.866614:0:7452:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783947313.866619:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe6fd1fdb554ffda3 00080000:01000000:2.0:1783947313.866625:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783947313.866628:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb554ffdaa 00080000:10000000:2.0:1783947313.867231:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1783947313.867376:0:7452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1783947313.934842:0:7452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1783947313.935166:0:7452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1783947313.941519:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1783947313.941944:0:7452:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783947313.964259:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1783947313.964342:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947313.964354:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.964356:0:7452:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1783947313.965315:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947313.965351:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.965354:0:7452:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1783947313.965362:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783947313.965368:0:7452:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:0.0:1783947313.965407:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947313.965428:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000bfdd9ba9) 00000020:00000080:0.0:1783947313.965977:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1783947313.965989:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783947313.967128:0:7452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1783947313.967140:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783947313.967167:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb554ffdb8 00010000:00080000:0.0:1783947313.967243:0:7452:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004a277374@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947313.982508:0:7452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1783947313.984333:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783947313.984351:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783947313.984399:0:7452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783947313.984431:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb554ffdbf 00000100:00080000:0.0:1783947313.984445:0:7452:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947313.984452:0:7452:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004a277374 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947313.984542:0:7452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c047079a x1870604235970688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947313.984730:0:7452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1783947313.984799:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947313.984804:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.984806:0:7452:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1783947313.984808:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783947313.984811:0:7452:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783947313.984813:0:7452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947313.984827:0:7452:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947313.984829:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783947313.984831:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.984833:0:7452:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783947313.984835:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947313.984840:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.984841:0:7452:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1783947313.984844:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783947313.984880:0:7452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1783947313.984895:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c047079a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604235970688:0@lo:38: 00000100:00100000:1.0:1783947313.984960:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947313.984971:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235970816:0@lo:400: 00000100:00100000:3.0:1783947313.985011:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947313.985018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783947313.985062:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947313.985066:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.985067:0:7452:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1783947313.985070:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947313.985072:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.985073:0:7452:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783947313.985075:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783947313.985077:0:7452:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783947313.985112:0:7452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947313.985114:0:7452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947313.985119:0:7452:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783947313.985126:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1783947313.985207:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970816 00000100:00100000:2.0:1783947313.985217:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970816 00000100:00100000:2.0:1783947313.985268:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947313.985275:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c78079b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235970816:12345-0@lo:400: 00000100:00100000:0.0:1783947313.986647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970688 00000100:00100000:0.0:1783947313.986661:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970688 00000100:00100000:0.0:1783947313.986699:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947313.986705:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d09b3e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604235970688:12345-0@lo:38: 00010000:00080000:0.0:1783947313.986734:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1783947313.986797:0:6515:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb554ffdc6 00000020:01000000:3.0:1783947313.995103:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1783947313.995309:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783947313.995397:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000790443f2/0xe6fd1fdb554ffd72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.995415:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000790443f2/0xe6fd1fdb554ffd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947313.995443:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be784d800 from 1 10000000:01000000:3.0:1783947313.995447:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947313.995517:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.995525:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.995537:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947313.995574:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075fa4743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970944:0@lo:101: 00000100:00100000:3.0:1783947313.995652:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947313.995681:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096639d40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947313.996009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235970944 00000100:00100000:3.0:1783947313.996019:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235970944 00000100:00100000:3.0:1783947313.996072:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783947313.996081:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000221e268c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+12:7440:x1870604235970944:12345-0@lo:101: 00000004:00100000:0.0:1783947313.996084:0:6515:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783947313.996095:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1783947313.996096:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947313.996112:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffdcd expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.996140:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.996212:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.996223:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd33b3fb, rc 0) 00000100:00100000:2.0:1783947313.996362:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c78079b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235970816:12345-0@lo:400: Request processed in 11085us (11344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947313.996379:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783947313.996406:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a1969b64 x1870604235970816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947313.996423:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235970816:0@lo:400: 00000100:00100000:3.0:1783947313.996529:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000221e268c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235970944:12345-0@lo:101: Request processed in 448us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947313.996536:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947313.996736:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075fa4743 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235970944:0@lo:101: 00010000:00010000:0.0:1783947313.996752:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947313.996776:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947313.997406:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ba7d289b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971072:0@lo:256: 00000100:00100000:0.0:1783947313.998012:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947313.998108:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055a7757a going to sleep for 11 seconds 00000100:00100000:1.0:1783947313.998163:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971072 00000100:00100000:1.0:1783947313.998171:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971072 00000100:00100000:1.0:1783947313.998249:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947313.998257:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feb43111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235971072:12345-0@lo:256: 20000000:01000000:1.0:1783947313.998283:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783947313.998308:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783947313.998312:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1783947313.998434:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feb43111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235971072:12345-0@lo:256: Request processed in 177us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947313.998452:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783947313.998712:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ba7d289b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971072:0@lo:256: 10000000:01000000:3.0:1783947313.999381:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947313.999411:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.999424:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947313.999433:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be784d800 from 1 10000000:01000000:3.0:1783947313.999437:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947313.999500:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.999509:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947313.999521:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947313.999541:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005bc9ec7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971200:0@lo:101: 00000100:00100000:2.0:1783947314.000928:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947314.000989:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032586028 going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.001038:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971200 00000100:00100000:3.0:1783947314.001048:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971200 00000100:00100000:3.0:1783947314.001113:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947314.001123:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a4aa7d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:7440:x1870604235971200:12345-0@lo:101: 00010000:00010000:3.0:1783947314.001145:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947314.001167:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffddb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.002908:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.002926:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.002937:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b26a39f, rc 0) 00000100:00100000:3.0:1783947314.003043:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a4aa7d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:7440:x1870604235971200:12345-0@lo:101: Request processed in 1920us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.003054:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947314.003179:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005bc9ec7e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971200:0@lo:101: 00010000:00010000:1.0:1783947314.003200:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.003211:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947314.003414:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971328:0@lo:501: 00000100:00100000:1.0:1783947314.003604:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947314.003648:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000014c97393 going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.003762:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971328 00000100:00100000:3.0:1783947314.003770:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971328 00000100:00100000:3.0:1783947314.003884:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783947314.003894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f646142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:7440:x1870604235971328:12345-0@lo:501: 00000100:00100000:3.0:1783947314.004012:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f646142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:7440:x1870604235971328:12345-0@lo:501: Request processed in 120us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.004019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947314.004106:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971328:0@lo:501: 00000100:00100000:1.0:1783947314.004141:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971456:0@lo:503: 00000100:00100000:1.0:1783947314.004185:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947314.004210:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000014c97393 going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.004359:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971456 00000100:00100000:3.0:1783947314.004364:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971456 00000100:00100000:3.0:1783947314.004625:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947314.004633:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093e540e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:7440:x1870604235971456:12345-0@lo:503: 00000040:00080000:3.0:1783947314.004671:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947314.004728:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093e540e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:7440:x1870604235971456:12345-0@lo:503: Request processed in 97us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.004735:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1783947314.005043:0:6515:0:(import.c:65:import_set_state_nolock()) 00000000922c30d6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947314.005098:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d09b3e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604235970688:12345-0@lo:38: Request processed in 18391us (20088us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947314.005110:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947314.005153:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971456:0@lo:503: 00000040:00080000:1.0:1783947314.005518:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947314.005598:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1783947314.005698:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947314.008390:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947314.008417:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783947314.008447:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1783947314.008469:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783947314.008474:0:3636:0:(import.c:65:import_set_state_nolock()) 000000004a277374 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783947314.008494:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c047079a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604235970688:0@lo:38: 00000100:00100000:2.0:1783947314.009014:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235971584:0@lo:41: 00000100:00100000:2.0:1783947314.009110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947314.009207:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971584 00000100:00100000:2.0:1783947314.009229:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971584 00000100:00100000:2.0:1783947314.009286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947314.009296:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e9c7967 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1870604235971584:12345-0@lo:41: 00000004:00000024:2.0:1783947314.009370:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1783947314.009425:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e9c7967 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1870604235971584:12345-0@lo:41: Request processed in 130us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947314.009433:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947314.009519:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235971584:0@lo:41: 00000040:00080000:0.0:1783947314.010735:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1783947314.016800:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1783947314.016867:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947314.016892:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.016909:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947314.017008:0:7440:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783947314.017011:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7be784d800 10000000:01000000:1.0:1783947314.017015:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7be784d800 10000000:01000000:1.0:1783947314.017039:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947314.017046:0:7440:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7be784d800 from 1 10000000:01000000:1.0:1783947314.017049:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947314.017231:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.017240:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.017252:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947314.017279:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971712:0@lo:101: 00000100:00100000:1.0:1783947314.017377:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947314.017441:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000014c97393 going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.017564:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971712 00000100:00100000:3.0:1783947314.017573:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971712 00000100:00100000:3.0:1783947314.017640:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947314.017652:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf00e63c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:7440:x1870604235971712:12345-0@lo:101: 00010000:00010000:3.0:1783947314.017668:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947314.017684:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe0764e2/0xe6fd1fdb554ffdf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffde9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.017713:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe0764e2/0xe6fd1fdb554ffdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.017724:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe0764e2/0xe6fd1fdb554ffdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.017734:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe0764e2, rc 0) 00000100:00100000:3.0:1783947314.017793:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf00e63c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235971712:12345-0@lo:101: Request processed in 143us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.017800:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947314.017852:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971712:0@lo:101: 00010000:00010000:1.0:1783947314.017867:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.017876:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947314.018045:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971840:0@lo:501: 00000100:00100000:1.0:1783947314.018192:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947314.018225:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000014c97393 going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.018236:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971840 00000100:00100000:3.0:1783947314.018242:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971840 00000100:00100000:3.0:1783947314.018274:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947314.018280:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dba588b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235971840:12345-0@lo:501: 00000100:00100000:3.0:1783947314.018410:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dba588b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235971840:12345-0@lo:501: Request processed in 130us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.018432:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947314.018447:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971840:0@lo:501: 00000100:00100000:1.0:1783947314.018511:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971968:0@lo:503: 00000100:00100000:1.0:1783947314.018552:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947314.018574:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000014c97393 going to sleep for 11 seconds 00000100:00100000:2.0:1783947314.018647:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235971968 00000100:00100000:2.0:1783947314.018652:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235971968 00000100:00100000:2.0:1783947314.018680:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783947314.018686:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055801b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235971968:12345-0@lo:503: 00000100:00100000:2.0:1783947314.018783:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055801b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235971968:12345-0@lo:503: Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947314.018789:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947314.018910:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235971968:0@lo:503: 00000040:00080000:2.0:1783947314.021394:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947314.022085:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235972096:0@lo:502: 00000100:00100000:2.0:1783947314.022211:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947314.022271:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000009f564bf going to sleep for 11 seconds 00000100:00100000:1.0:1783947314.022314:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972096 00000100:00100000:1.0:1783947314.022340:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972096 00000100:00100000:1.0:1783947314.022398:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947314.022407:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbf62c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235972096:12345-0@lo:502: 00000100:00100000:1.0:1783947314.022582:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbf62c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235972096:12345-0@lo:502: Request processed in 175us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947314.022590:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783947314.023130:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235972096:0@lo:502: 00000040:00080000:2.0:1783947314.023436:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783947314.024039:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783947314.024060:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783947314.024084:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783947314.024160:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783947314.024174:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783947314.024188:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783947314.024199:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783947314.024224:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783947314.024235:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783947314.024245:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783947314.024256:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783947314.024269:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783947314.024279:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783947314.024290:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783947314.024301:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783947314.024312:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783947314.024336:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783947314.024352:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783947314.024364:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783947314.024375:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783947314.024387:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783947314.024400:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783947314.024412:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783947314.024422:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783947314.024435:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783947314.024447:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783947314.024505:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1783947314.024560:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235972224:0@lo:502: 00000100:00100000:2.0:1783947314.024644:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947314.024684:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000009f564bf going to sleep for 11 seconds 00000100:00100000:1.0:1783947314.026481:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972224 00000100:00100000:1.0:1783947314.026502:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972224 00000100:00100000:1.0:1783947314.026582:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783947314.026592:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd3299ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235972224:12345-0@lo:502: 00000100:00100000:1.0:1783947314.026792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd3299ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235972224:12345-0@lo:502: Request processed in 201us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947314.026800:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783947314.026902:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235972224:0@lo:502: 00000040:00080000:2.0:1783947314.027021:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1783947314.027038:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1783947314.028420:0:7458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1783947314.028442:0:7458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000005be0d43e) 00000020:00000080:2.0:1783947314.028498:0:7458:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1783947314.028722:0:7458:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000062976cc1 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783947314.028727:0:7458:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000062976cc1 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783947314.028736:0:7458:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000062976cc1 3 00010000:00080000:2.0:1783947314.028779:0:7458:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004201a2b2@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1783947314.037127:0:7458:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1783947314.037304:0:7458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1783947314.037373:0:7458:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783947314.037391:0:7458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe6fd1fdb554ffdfe 00000100:00080000:2.0:1783947314.037404:0:7458:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947314.037411:0:7458:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000004201a2b2 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947314.037481:0:7458:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000086140a58 x1870604235972352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947314.037518:0:7458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783947314.037742:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604235972352:0@lo:38: 00000100:00100000:0.0:1783947314.037833:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947314.038781:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972352 00000100:00100000:2.0:1783947314.038794:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972352 00000100:00100000:2.0:1783947314.039230:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947314.039238:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083f61ae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604235972352:12345-0@lo:38: 00010000:00080000:2.0:1783947314.039273:0:6510:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1783947314.039331:0:6510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe6fd1fdb554ffe05 00000004:00100000:2.0:1783947314.039352:0:6510:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783947314.039407:0:6510:0:(import.c:65:import_set_state_nolock()) 000000000ace51d4 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947314.040136:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083f61ae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870604235972352:12345-0@lo:38: Request processed in 892us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947314.040149:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783947314.040661:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000086140a58 x1870604235972352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947314.040676:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947314.040688:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1783947314.040697:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783947314.040703:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783947314.040706:0:3636:0:(import.c:65:import_set_state_nolock()) 000000004201a2b2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947314.040713:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604235972352:0@lo:38: 00000040:00080000:2.0:1783947314.041040:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1783947314.041286:0:7460:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1783947314.041789:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1783947314.041829:0:7440:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947314.041852:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffde9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947314.042676:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000b92b3749/0xe6fd1fdb554ffde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783947314.042750:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783947314.042758:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947314.042759:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947314.042760:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947314.042761:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947314.042762:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947314.042763:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947314.042765:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783947314.042766:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783947314.042767:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947314.042769:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947314.042773:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1783947314.042776:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947314.042776:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947314.042778:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947314.042779:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947314.042780:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947314.042781:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947314.042781:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947314.042783:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783947314.042783:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783947314.042784:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947314.042785:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947314.042819:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783947314.042840:0:7440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000076a63692 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235972480:0@lo:253: 00000100:00100000:0.0:1783947314.043055:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947314.043116:0:7440:0:(client.c:2702:ptlrpc_set_wait()) set 0000000031a93c9d going to sleep for 11 seconds 00000100:00100000:1.0:1783947314.043150:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972480 00000100:00100000:1.0:1783947314.043160:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972480 00000100:00100000:1.0:1783947314.043224:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947314.043234:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072927ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235972480:12345-0@lo:253: 20000000:01000000:1.0:1783947314.043265:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783947314.043281:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1783947314.049980:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783947314.050167:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783947314.050189:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1783947314.050318:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783947314.050333:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783947314.050358:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.050380:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.050399:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.050406:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.050454:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.050499:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 15 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947314.050515:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082cb1ecc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235972608:0@lo:104: 00000100:00100000:1.0:1783947314.050610:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947314.050639:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072927ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7440:x1870604235972480:12345-0@lo:253: Request processed in 7404us (7582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.050653:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1783947314.050671:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.050680:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 14 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947314.050690:0:7440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000076a63692 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7440:1870604235972480:0@lo:253: 00000100:00100000:1.0:1783947314.050691:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235972736:0@lo:104: 10000000:01000000:0.0:1783947314.050711:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783947314.050715:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947314.050717:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947314.050719:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947314.050721:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947314.050724:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:1.0:1783947314.050727:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1783947314.050728:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947314.050731:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947314.050732:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783947314.050734:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783947314.050735:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947314.050746:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1783947314.050756:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af89a9a4 going to sleep for 11 seconds 00000020:02000000:0.0:1783947314.050767:0:7440:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783947314.050779:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972608 00000100:00100000:1.0:1783947314.050787:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972608 00000100:00100000:1.0:1783947314.050819:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972736 00000100:00100000:1.0:1783947314.050822:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972736 00000100:00100000:1.0:1783947314.050835:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947314.050848:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000616711dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6526:x1870604235972608:12345-0@lo:104: 00010000:00010000:1.0:1783947314.050870:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.050967:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947314.050972:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000616711dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6526:x1870604235972608:12345-0@lo:104: Request processed in 131us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947314.050980:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947314.050994:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947314.050999:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058d28dd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604235972736:12345-0@lo:104: 00010000:00010000:1.0:1783947314.051006:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051131:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1783947314.051135:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783947314.051137:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058d28dd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604235972736:12345-0@lo:104: Request processed in 137us (413us total) trans 0 rc 0/0 00010000:00010000:3.0:1783947314.051144:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947314.051146:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783947314.051157:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087ff5167 already unused, calling callback (0000000061d09b67) 10000000:00010000:3.0:1783947314.051162:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051170:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947314.051171:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947314.051181:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947314.051187:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1783947314.051204:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082cb1ecc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235972608:0@lo:104: 00000100:00100000:1.0:1783947314.051214:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1969b64 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235972736:0@lo:104: 00010000:00010000:3.0:1783947314.051229:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051231:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.051318:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947314.051352:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.051371:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 0000000087ff5167/0xe6fd1fdb554ffdcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffdd4 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947314.051383:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235972864:0@lo:103: 00010000:00010000:3.0:1783947314.051386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947314.051390:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947314.051391:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947314.051416:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947314.051548:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972864 00000100:00100000:3.0:1783947314.051554:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972864 00010000:00010000:1.0:1783947314.051564:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947314.051570:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.051580:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 15 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051604:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066cf8c3a already unused, calling callback (0000000061d09b67) 10000000:00010000:1.0:1783947314.051608:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051614:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947314.051621:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947314.051627:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 10000000:01000000:1.0:1783947314.051630:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1783947314.051638:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1969b64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3637:x1870604235972864:12345-0@lo:103: 00010000:00010000:3.0:1783947314.051652:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947314.051655:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.051660:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 15 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051668:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947314.051679:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 15 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051682:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051695:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 0000000066cf8c3a/0xe6fd1fdb554ffd25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd2c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.051700:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cd33b3fb/0xe6fd1fdb554ffdd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffdcd expref: 15 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947314.051712:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947314.051715:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947314.051717:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947314.051731:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082cb1ecc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235972992:0@lo:103: 00000100:00100000:1.0:1783947314.051760:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947314.051799:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783947314.051808:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1783947314.051933:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947314.051974:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1969b64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:3637:x1870604235972864:12345-0@lo:103: Request processed in 338us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.051982:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947314.051996:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235972992 00000100:00100000:3.0:1783947314.052005:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235972992 00010000:00010000:3.0:1783947314.052019:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 14 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947314.052034:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947314.052039:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fbe883f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:3638:x1870604235972992:12345-0@lo:103: 00010000:00010000:3.0:1783947314.052046:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947314.052049:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 14 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052056:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 14 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052064:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000379db0ca/0xe6fd1fdb554ffd2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd25 expref: 14 pid: 6504 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052077:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052084:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947314.052098:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002911906s 00010000:00010000:3.0:1783947314.052102:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052108:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052114:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052128:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052133:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f516cda7 already unused, calling callback (0000000012aa3ab0) 00010000:00010000:3.0:1783947314.052137:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052144:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052158:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052168:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947314.052196:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fbe883f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:3638:x1870604235972992:12345-0@lo:103: Request processed in 158us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.052203:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783947314.052288:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947314.052311:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947314.052360:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052369:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947314.052373:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947314.052405:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235972864:0@lo:103: 00000100:00100000:3.0:1783947314.052431:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082cb1ecc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235972992:0@lo:103: 00080000:10000000:0.0:1783947314.059198:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1783947314.059404:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1783947314.059696:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1783947314.059864:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1783947314.060058:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1783947314.060217:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1783947314.066959:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1783947314.068595:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1783947314.069197:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1783947314.069376:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1783947314.069622:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1783947314.071287:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1783947314.079160:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1783947314.079257:0:7465:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1783947314.079262:0:7465:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783947314.079749:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783947314.079794:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1783947314.080270:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000076a63692 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973248:0@lo:1000: 00000100:00100000:2.0:1783947314.080291:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe44f3a8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1870604235973120:0@lo:700: 00000100:00100000:0.0:1783947314.080387:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947314.080451:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set 000000007afdbdca going to sleep for 11 seconds 00000100:00100000:2.0:1783947314.080496:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947314.080544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235973248 00000100:00100000:3.0:1783947314.080560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235973248 00000100:00100000:2.0:1783947314.080575:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cccfa737 going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.080688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947314.080698:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b62b56b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973248:12345-0@lo:1000: 00000100:00100000:3.0:1783947314.080831:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b62b56b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973248:12345-0@lo:1000: Request processed in 135us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.080838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947314.081317:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235973120 00000040:01000000:1.0:1783947314.081331:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1783947314.081453:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235973120 00000040:00080000:1.0:1783947314.081490:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947314.081534:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947314.081542:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af36bf92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1870604235973120:12345-0@lo:700: 00000100:00100000:3.0:1783947314.081791:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000076a63692 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973248:0@lo:1000: 00000040:01000000:3.0:1783947314.082032:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1783947314.082075:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973376:0@lo:700: 00000100:00100000:3.0:1783947314.082131:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947314.082161:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d44b3910 going to sleep for 11 seconds 00000100:00100000:0.0:1783947314.082193:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235973376 00000100:00100000:0.0:1783947314.082198:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235973376 00000100:00100000:0.0:1783947314.082238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947314.082245:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f80c3a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973376:12345-0@lo:700: 00000004:00000080:1.0:1783947314.082254:0:7440:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783947314.082266:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1783947314.082412:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f80c3a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973376:12345-0@lo:700: Request processed in 167us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947314.082422:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947314.082432:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973376:0@lo:700: 00000100:00100000:3.0:1783947314.082521:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1870604235973504:0@lo:900: 00000040:00080000:1.0:1783947314.082522:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947314.082555:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947314.082568:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d44b3910 going to sleep for 11 seconds 00000100:00100000:2.0:1783947314.082627:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235973504 00000100:00100000:2.0:1783947314.082632:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235973504 00000100:00100000:2.0:1783947314.082705:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947314.082711:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe9aaaf pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1870604235973504:12345-0@lo:900: 00000100:00100000:2.0:1783947314.083068:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe9aaaf pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1870604235973504:12345-0@lo:900: Request processed in 357us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947314.083076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783947314.083129:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000020d4a93b x1870604235973504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947330 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947314.083141:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1870604235973504:0@lo:900: 00000100:00100000:3.0:1783947314.083240:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973632:0@lo:1000: 00000100:00100000:3.0:1783947314.083278:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947314.083349:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set 0000000032586028 going to sleep for 11 seconds 00000100:00100000:2.0:1783947314.083392:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235973632 00000100:00100000:2.0:1783947314.083398:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235973632 00000100:00100000:2.0:1783947314.083496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947314.083505:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c27276 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973632:12345-0@lo:1000: 00000100:00100000:2.0:1783947314.083576:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c27276 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973632:12345-0@lo:1000: Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947314.083583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947314.083649:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020d4a93b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973632:0@lo:1000: 00000004:00080000:0.0:1783947314.083691:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d44b3910 with version 0 00000020:00100000:0.0:1783947314.083707:0:7467:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783947314.083713:0:7467:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006bbcebb2 x1870604235973888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947314.083726:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973888:0@lo:1000: 00000100:00100000:0.0:1783947314.083773:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947314.084047:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f95295b7 going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.084076:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235973888 00000100:00100000:3.0:1783947314.084080:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235973888 00000100:00100000:3.0:1783947314.084105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947314.084110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000835a7940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973888:12345-0@lo:1000: 00000040:00080000:0.0:1783947314.086292:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783947314.087133:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783947314.087308:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783947314.087681:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783947314.088570:0:7440:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783947314.090775:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783947314.090937:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783947314.091079:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783947314.092310:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783947314.092562:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783947314.092931:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783947314.093101:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783947314.093331:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783947314.093526:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783947314.093665:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783947314.093824:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783947314.094018:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783947314.094378:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783947314.094667:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783947314.094813:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783947314.095010:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783947314.095366:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783947314.096030:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783947314.096147:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783947314.096441:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783947314.099602:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783947314.100042:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783947314.100198:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783947314.100376:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783947314.100591:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783947314.100771:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000001:00080000:0.0:1783947314.102762:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:1.0:1783947314.103454:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1783947314.104100:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783947314.104349:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783947314.104529:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783947314.104704:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783947314.104843:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783947314.105018:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783947314.105296:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1783947314.108899:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000835a7940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235973888:12345-0@lo:1000: Request processed in 24772us (25109us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783947314.108956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1783947314.109064:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1783947314.109075:0:7467:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783947314.109103:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235973888:0@lo:1000: 00000100:00100000:0.0:1783947314.109391:0:7467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235974016:0@lo:1000: 00000100:00100000:0.0:1783947314.109493:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947314.109569:0:7467:0:(client.c:2702:ptlrpc_set_wait()) set 000000001132dbeb going to sleep for 11 seconds 00000100:00100000:3.0:1783947314.109570:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235974016 00000100:00100000:3.0:1783947314.109583:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235974016 00000100:00100000:3.0:1783947314.109650:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947314.109660:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000319600ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235974016:12345-0@lo:1000: 00000100:00100000:3.0:1783947314.109771:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000319600ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1870604235974016:12345-0@lo:1000: Request processed in 113us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947314.109779:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947314.109813:0:7467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1870604235974016:0@lo:1000: 00000040:00080000:0.0:1783947314.109833:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1783947314.109868:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f95295b7 with version 1 00000100:00100000:2.0:1783947314.114771:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af36bf92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1870604235973120:12345-0@lo:700: Request processed in 33215us (34263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947314.114814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1783947314.117619:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00010000:00080000:3.0:1783947314.117635:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fe44f3a8 x1870604235973120/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783947330 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947314.117660:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe44f3a8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1870604235973120:0@lo:700: 40000000:02000000:3.0:1783947314.117679:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:0.0:1783947314.117726:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783947314.119105:0:7455:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000007d0924ec version 1 rpc_version 1 00000020:00100000:0.0:1783947314.119156:0:7455:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783947314.119167:0:7455:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006bbcebb2 x1870604235974272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947314.119273:0:7455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1870604235974272:0@lo:1000: 00000100:00100000:0.0:1783947314.119366:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947314.119432:0:7455:0:(client.c:2702:ptlrpc_set_wait()) set 000000002890f121 going to sleep for 11 seconds 00000100:00100000:0.0:1783947314.120623:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235974272 00000100:00100000:0.0:1783947314.120637:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235974272 00000100:00100000:0.0:1783947314.120730:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947314.120739:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a420fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7455:x1870604235974272:12345-0@lo:1000: 00000001:00080000:2.0:1783947314.120904:0:7440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783947314.124989:0:7440:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb79481cb7988 00100000:10000000:2.0:1783947314.125014:0:7440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783947314.126544:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783947314.126592:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783947314.126612:0:7440:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783947314.126636:0:7440:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1783947314.127784:0:7440:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947314.128152:0:7440:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:3.0:1783947314.140705:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1783947314.160270:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a420fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7455:x1870604235974272:12345-0@lo:1000: Request processed in 39518us (40891us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783947314.160293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1783947314.164563:0:7455:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1783947314.164636:0:7455:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783947314.164723:0:7455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7455:1870604235974272:0@lo:1000: 00000040:00080000:3.0:1783947314.192913:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947314.211589:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783947314.211688:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783947314.211693:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1783947314.363696:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947315.380640:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947316.404183:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947317.427847:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947318.453108:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947318.651676:0:7712:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783947319.027733:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000682c0041 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235974400:0@lo:41: 00000100:00100000:2.0:1783947319.027822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947319.028029:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235974400 00000100:00100000:1.0:1783947319.028038:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235974400 00000100:00100000:1.0:1783947319.028822:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947319.028835:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ee4585f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235974400:12345-0@lo:41: 00000004:00000024:1.0:1783947319.028879:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1783947319.028945:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ee4585f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235974400:12345-0@lo:41: Request processed in 114us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947319.028964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947319.029056:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000682c0041 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235974400:0@lo:41: 00010000:00010000:2.0:1783947319.475712:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947319.541972:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947319.541999:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235974528:0@lo:400: 00000100:00100000:2.0:1783947319.542073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947319.542125:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b9e0b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604235974656:0@lo:400: 00000100:00100000:2.0:1783947319.542154:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947319.542173:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947319.542177:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d55d8f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235974784:0@lo:400: 00000100:00100000:2.0:1783947319.542195:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947319.542253:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235974528 00000100:00100000:2.0:1783947319.542261:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235974528 00000100:00100000:2.0:1783947319.542308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783947319.542315:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039bdc8f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:3639:x1870604235974528:12345-0@lo:400: 00000100:00100000:2.0:1783947319.542376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039bdc8f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:3639:x1870604235974528:12345-0@lo:400: Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947319.542383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783947319.542413:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235974656 00000100:00100000:2.0:1783947319.542417:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235974656 00000100:00100000:2.0:1783947319.542438:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235974784 00000100:00100000:2.0:1783947319.542440:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235974784 00000100:00100000:2.0:1783947319.542452:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947319.542474:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009edf2756 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604235974656:12345-0@lo:400: 00000100:00100000:2.0:1783947319.542508:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009edf2756 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604235974656:12345-0@lo:400: Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947319.542513:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947319.542524:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947319.542528:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5d568e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235974784:12345-0@lo:400: 00000100:00100000:2.0:1783947319.542563:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5d568e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235974784:12345-0@lo:400: Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947319.542569:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783947319.542609:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006d55d8f9 x1870604235974784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947319.542623:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d55d8f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235974784:0@lo:400: 00010000:00080000:2.0:1783947319.542633:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004b9e0b12 x1870604235974656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947319.542640:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b9e0b12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604235974656:0@lo:400: 00000100:00100000:2.0:1783947319.542683:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235974528:0@lo:400: 00000020:00000004:3.0:1783947319.692839:0:7764:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947319.693053:0:7764:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947320.502326:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783947321.075931:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947321.075941:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be784d800 from 4 10000000:01000000:1.0:1783947321.075947:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947321.076003:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 000000003f599d9e/0xe6fd1fdb554ffe13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.076015:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 000000003f599d9e/0xe6fd1fdb554ffe13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.076027:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 000000003f599d9e/0xe6fd1fdb554ffe13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947321.076056:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235974912:0@lo:101: 00000100:00100000:1.0:1783947321.076144:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.076240:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235974912 00000100:00100000:3.0:1783947321.076249:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235974912 00000100:00100000:1.0:1783947321.076282:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bd4f8e8 going to sleep for 11 seconds 00000100:00100000:3.0:1783947321.076301:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783947321.076310:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077261f8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:6507:x1870604235974912:12345-0@lo:101: 00010000:00010000:3.0:1783947321.076328:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947321.076343:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087ff5167/0xe6fd1fdb554ffe1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffe13 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947321.076379:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087ff5167/0xe6fd1fdb554ffe1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947321.076390:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087ff5167/0xe6fd1fdb554ffe1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947321.076410:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087ff5167, rc 0) 00000100:00100000:3.0:1783947321.076489:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077261f8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:6507:x1870604235974912:12345-0@lo:101: Request processed in 180us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947321.076496:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947321.076594:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235974912:0@lo:101: 00010000:00010000:1.0:1783947321.076609:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 000000003f599d9e/0xe6fd1fdb554ffe13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.076617:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 000000003f599d9e/0xe6fd1fdb554ffe13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947321.076683:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975040:0@lo:256: 00000100:00100000:1.0:1783947321.076715:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947321.076781:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975040 00000100:00100000:2.0:1783947321.076786:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975040 00000100:00100000:2.0:1783947321.076824:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947321.076831:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000246c6541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:6507:x1870604235975040:12345-0@lo:256: 20000000:01000000:2.0:1783947321.076847:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783947321.076863:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783947321.076866:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1783947321.076932:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000246c6541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:6507:x1870604235975040:12345-0@lo:256: Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947321.076938:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947321.092217:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bd4f8e8 going to sleep for 11 seconds 00000100:00100000:1.0:1783947321.092273:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975040:0@lo:256: 10000000:01000000:1.0:1783947321.092357:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947321.092369:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 000000003f599d9e/0xe6fd1fdb554ffe13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.092381:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 000000003f599d9e/0xe6fd1fdb554ffe13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947321.092394:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783947321.092615:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc9511800 from 21 10000000:01000000:1.0:1783947321.092620:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947321.092663:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffe21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.092671:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffe21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.092697:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffe21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947321.092719:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975168:0@lo:101: 00000100:00100000:1.0:1783947321.092786:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947321.092844:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050062313 going to sleep for 11 seconds 00000100:00100000:2.0:1783947321.094182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975168 00000100:00100000:2.0:1783947321.094206:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975168 00000100:00100000:2.0:1783947321.094340:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947321.094350:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000042dd898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:6507:x1870604235975168:12345-0@lo:101: 00010000:00010000:2.0:1783947321.094372:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947321.094395:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a18de75/0xe6fd1fdb554ffe28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffe21 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.094426:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a18de75/0xe6fd1fdb554ffe28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.094437:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a18de75/0xe6fd1fdb554ffe28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.094446:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a18de75, rc 0) 00000100:00100000:2.0:1783947321.094573:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000042dd898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235975168:12345-0@lo:101: Request processed in 224us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947321.094596:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947321.094696:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975168:0@lo:101: 00010000:00010000:1.0:1783947321.094716:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffe21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.094724:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffe21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947321.094803:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975296:0@lo:501: 00000100:00100000:1.0:1783947321.096335:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947321.100519:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050062313 going to sleep for 11 seconds 00000100:00100000:3.0:1783947321.101003:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975296 00000100:00100000:3.0:1783947321.101015:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975296 00000100:00100000:3.0:1783947321.101085:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947321.101096:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5dedef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235975296:12345-0@lo:501: 00000100:00100000:3.0:1783947321.101345:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5dedef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235975296:12345-0@lo:501: Request processed in 251us (5015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947321.101354:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783947321.109140:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975296:0@lo:501: 00000100:00100000:1.0:1783947321.109237:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975424:0@lo:503: 00000100:00100000:1.0:1783947321.109323:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947321.109381:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050062313 going to sleep for 11 seconds 00000100:00100000:2.0:1783947321.110048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975424 00000100:00100000:2.0:1783947321.110056:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975424 00000100:00100000:2.0:1783947321.110124:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783947321.110134:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004099d8db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235975424:12345-0@lo:503: 00000100:00100000:2.0:1783947321.112409:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004099d8db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235975424:12345-0@lo:503: Request processed in 2267us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947321.112426:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947321.116874:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975424:0@lo:503: 00000100:00100000:0.0:1783947321.130099:0:7816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7816:1870604235975552:0@lo:502: 00000100:00100000:0.0:1783947321.130218:0:7816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947321.130270:0:7816:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f36f398b going to sleep for 11 seconds 00000100:00100000:3.0:1783947321.130416:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975552 00000100:00100000:3.0:1783947321.130424:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975552 00000100:00100000:3.0:1783947321.130498:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947321.130506:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fc35368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7816:x1870604235975552:12345-0@lo:502: 00000100:00100000:3.0:1783947321.130748:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fc35368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7816:x1870604235975552:12345-0@lo:502: Request processed in 163us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947321.130756:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783947321.130909:0:7816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006bbcebb2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7816:1870604235975552:0@lo:502: 00000100:00100000:1.0:1783947321.130966:0:7816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7816:1870604235975680:0@lo:502: 00000100:00100000:1.0:1783947321.131000:0:7816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947321.131038:0:7816:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050062313 going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.131092:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975680 00000100:00100000:0.0:1783947321.131097:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975680 00000100:00100000:0.0:1783947321.131131:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783947321.131138:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc6f330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7816:x1870604235975680:12345-0@lo:502: 00000100:00100000:0.0:1783947321.131240:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc6f330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:7816:x1870604235975680:12345-0@lo:502: Request processed in 103us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.131247:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947321.131368:0:7816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7816:1870604235975680:0@lo:502: 00000040:00080000:1.0:1783947321.131387:0:7816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1783947321.131562:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1783947321.131585:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947321.131595:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffe21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.131606:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000ffcbf067/0xe6fd1fdb554ffe21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947321.131615:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783947321.131618:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bc9511800 from 4 10000000:01000000:2.0:1783947321.131621:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783947321.131659:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000a7b7138e/0xe6fd1fdb554ffe2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.131667:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000a7b7138e/0xe6fd1fdb554ffe2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.131684:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000a7b7138e/0xe6fd1fdb554ffe2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947321.131698:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975808:0@lo:101: 00000100:00100000:2.0:1783947321.131737:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947321.131756:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f5be205 going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.132301:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975808 00000100:00100000:0.0:1783947321.132309:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975808 00000100:00100000:0.0:1783947321.132350:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783947321.132364:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063fb2cd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235975808:12345-0@lo:101: 00010000:00010000:0.0:1783947321.132378:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947321.132392:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e2209c4/0xe6fd1fdb554ffe36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffe2f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.132417:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e2209c4/0xe6fd1fdb554ffe36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.132428:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e2209c4/0xe6fd1fdb554ffe36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.132438:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e2209c4, rc 0) 00000100:00100000:0.0:1783947321.132501:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063fb2cd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235975808:12345-0@lo:101: Request processed in 137us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.132508:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783947321.134108:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975808:0@lo:101: 00010000:00010000:2.0:1783947321.134136:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000a7b7138e/0xe6fd1fdb554ffe2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.134148:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000a7b7138e/0xe6fd1fdb554ffe2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947321.134238:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975936:0@lo:256: 00000100:00100000:2.0:1783947321.134295:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947321.134337:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f5be205 going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.134400:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235975936 00000100:00100000:0.0:1783947321.134408:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235975936 00000100:00100000:0.0:1783947321.134480:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947321.134489:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfe59a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235975936:12345-0@lo:256: 20000000:01000000:0.0:1783947321.134513:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783947321.134529:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783947321.134533:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783947321.134623:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfe59a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235975936:12345-0@lo:256: Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.134630:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783947321.134954:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235975936:0@lo:256: 10000000:01000000:2.0:1783947321.135003:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947321.135012:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000a7b7138e/0xe6fd1fdb554ffe2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.135022:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000a7b7138e/0xe6fd1fdb554ffe2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947321.135030:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783947321.135033:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1783947321.135036:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783947321.135078:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000f9fef45b/0xe6fd1fdb554ffe3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.135086:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000f9fef45b/0xe6fd1fdb554ffe3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.135105:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000f9fef45b/0xe6fd1fdb554ffe3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947321.135119:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235976064:0@lo:101: 00000100:00100000:2.0:1783947321.135146:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947321.135173:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f5be205 going to sleep for 11 seconds 00000100:00100000:1.0:1783947321.135251:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976064 00000100:00100000:1.0:1783947321.135257:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976064 00000100:00100000:1.0:1783947321.135295:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783947321.135301:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1615d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235976064:12345-0@lo:101: 00010000:00010000:1.0:1783947321.135312:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947321.135324:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffe3d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.135343:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.135352:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f516cda7/0xe6fd1fdb554ffe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947321.135360:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f516cda7, rc 0) 00000100:00100000:1.0:1783947321.135398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1615d96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235976064:12345-0@lo:101: Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947321.135405:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783947321.135492:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235976064:0@lo:101: 00010000:00010000:2.0:1783947321.135503:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000f9fef45b/0xe6fd1fdb554ffe3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947321.135511:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000f9fef45b/0xe6fd1fdb554ffe3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947321.135574:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235976192:0@lo:501: 00000100:00100000:2.0:1783947321.135599:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947321.135716:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f5be205 going to sleep for 11 seconds 00000100:00100000:3.0:1783947321.145102:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976192 00000100:00100000:3.0:1783947321.145119:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976192 00000100:00100000:3.0:1783947321.145310:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783947321.145335:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047e27fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235976192:12345-0@lo:501: 00000100:00100000:3.0:1783947321.145564:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047e27fa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235976192:12345-0@lo:501: Request processed in 231us (9964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947321.145573:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783947321.146493:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235976192:0@lo:501: 00000100:00100000:1.0:1783947321.146562:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235976320:0@lo:503: 00000100:00100000:1.0:1783947321.146624:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947321.146659:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000005d8d33eb going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.146776:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976320 00000100:00100000:0.0:1783947321.146783:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976320 00000100:00100000:0.0:1783947321.146833:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783947321.146841:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5f858a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235976320:12345-0@lo:503: 00000100:00100000:0.0:1783947321.146964:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5f858a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235976320:12345-0@lo:503: Request processed in 124us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.146972:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783947321.147053:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235976320:0@lo:503: 00000100:00100000:1.0:1783947321.147522:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7817:1870604235976448:0@lo:502: 00000100:00100000:1.0:1783947321.147567:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947321.147586:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000039e6b5a5 going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.147632:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976448 00000100:00100000:0.0:1783947321.147638:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976448 00000100:00100000:0.0:1783947321.147681:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783947321.147688:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd44f30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:7817:x1870604235976448:12345-0@lo:502: 00000100:00100000:0.0:1783947321.147776:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd44f30b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:7817:x1870604235976448:12345-0@lo:502: Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.147783:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947321.147913:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f8156769 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7817:1870604235976448:0@lo:502: 00000020:01000000:1.0:1783947321.147936:0:7817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947321.147949:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947321.147952:0:7817:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783947321.147964:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783947321.147968:0:7817:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:1.0:1783947321.147996:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947321.148011:0:7817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000bdf9245f) 00000020:00000080:1.0:1783947321.148033:0:7817:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1783947321.148038:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783947321.148118:0:7817:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783947321.148124:0:7817:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783947321.148131:0:7817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb554ffe52 00010000:00080000:1.0:1783947321.148162:0:7817:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a775ca07@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1783947321.153269:0:7817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1783947321.154367:0:7817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947321.154386:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783947321.154428:0:7817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783947321.154453:0:7817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb554ffe59 00000100:00080000:0.0:1783947321.154499:0:7817:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947321.154505:0:7817:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a775ca07 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947321.154548:0:7817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c0519f51 x1870604235976576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947321.154570:0:7817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783947321.154808:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c0519f51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604235976576:0@lo:38: 00000100:00100000:2.0:1783947321.154883:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1783947321.154992:0:7817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1783947321.155060:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000142e48ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235976832:0@lo:400: 00000100:00100000:1.0:1783947321.155094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.156899:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a294384a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235976960:0@lo:400: 00000100:00100000:3.0:1783947321.156967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947321.157133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976576 00000100:00100000:2.0:1783947321.157143:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976576 00000100:00100000:2.0:1783947321.157168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976832 00000100:00100000:2.0:1783947321.157171:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976832 00000100:00100000:2.0:1783947321.157212:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947321.157218:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b9e0b12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604235976576:12345-0@lo:38: 00010000:00080000:2.0:1783947321.157251:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1783947321.157304:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb554ffe60 00000004:00100000:2.0:1783947321.157319:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783947321.157326:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1783947321.157398:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976960 00000100:00100000:2.0:1783947321.157402:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976960 00000100:00100000:2.0:1783947321.157432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947321.157438:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051d2ee04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235976960:12345-0@lo:400: 00000100:00100000:2.0:1783947321.157510:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051d2ee04 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235976960:12345-0@lo:400: Request processed in 72us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947321.157517:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1783947321.160884:0:7820:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000006d55d8f9 x1870604235977088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947321.160901:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e6bbd08 going to sleep for 0 seconds 00000020:01000000:0.0:1783947321.161106:0:7817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947321.161116:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947321.161118:0:7817:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783947321.161122:0:7817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947321.161127:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947321.161128:0:7817:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783947321.161131:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783947321.161133:0:7817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783947321.161161:0:7817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7817:1870604235977216:0@lo:502: 00000100:00100000:0.0:1783947321.161263:0:7817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947321.161309:0:7817:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0bce240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947321.161438:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977216 00000100:00100000:2.0:1783947321.161446:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977216 00000100:00100000:2.0:1783947321.161511:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783947321.161519:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa2bb937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:7817:x1870604235977216:12345-0@lo:502: 00000100:00100000:2.0:1783947321.161649:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa2bb937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:7817:x1870604235977216:12345-0@lo:502: Request processed in 130us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947321.161656:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783947321.161780:0:7817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:7817:1870604235977216:0@lo:502: 00000020:01000000:0.0:1783947321.161810:0:7817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947321.161814:0:7817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947321.161815:0:7817:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783947321.161818:0:7817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1783947321.161874:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1783947321.161899:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783947321.161910:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000f9fef45b/0xe6fd1fdb554ffe3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.161920:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000f9fef45b/0xe6fd1fdb554ffe3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947321.161931:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783947321.161934:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e7bc5510000 from 1 10000000:01000000:0.0:1783947321.161937:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783947321.161962:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000379db0ca/0xe6fd1fdb554ffe67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.161968:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000379db0ca/0xe6fd1fdb554ffe67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.161977:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000379db0ca/0xe6fd1fdb554ffe67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947321.161989:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235977344:0@lo:101: 00000100:00100000:0.0:1783947321.162017:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947321.162045:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0bce240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.162059:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977344 00000100:00100000:0.0:1783947321.162063:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977344 00000100:00100000:0.0:1783947321.162084:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783947321.162090:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b427cd65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235977344:12345-0@lo:101: 00010000:00010000:0.0:1783947321.162100:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947321.162115:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2ba095b/0xe6fd1fdb554ffe6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffe67 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.162137:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2ba095b/0xe6fd1fdb554ffe6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.162149:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2ba095b/0xe6fd1fdb554ffe6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.162158:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2ba095b, rc 0) 00000100:00100000:0.0:1783947321.162207:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b427cd65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235977344:12345-0@lo:101: Request processed in 94us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.162213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783947321.162245:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235977344:0@lo:101: 00010000:00010000:0.0:1783947321.162256:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000379db0ca/0xe6fd1fdb554ffe67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.162264:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000379db0ca/0xe6fd1fdb554ffe67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947321.162314:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235977472:0@lo:501: 00000100:00100000:0.0:1783947321.162337:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947321.162349:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0bce240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.162364:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977472 00000100:00100000:0.0:1783947321.162367:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977472 00000100:00100000:0.0:1783947321.162384:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783947321.162388:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c96ea0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235977472:12345-0@lo:501: 00000100:00100000:0.0:1783947321.162453:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c96ea0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235977472:12345-0@lo:501: Request processed in 65us (116us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947321.162484:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783947321.162511:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235977472:0@lo:501: 10000000:01000000:0.0:1783947321.162532:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783947321.162536:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: 00000000379db0ca/0xe6fd1fdb554ffe67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947321.162541:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: 00000000379db0ca/0xe6fd1fdb554ffe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947321.163070:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947321.163081:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044c7969d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235976704:0@lo:400: 00000100:00100000:1.0:1783947321.163116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947321.163198:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235976704 00000100:00100000:2.0:1783947321.163203:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235976704 00000100:00100000:2.0:1783947321.163244:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947321.163250:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e0f5f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235976704:12345-0@lo:400: 00000100:00100000:2.0:1783947321.163300:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e0f5f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235976704:12345-0@lo:400: Request processed in 50us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947321.163307:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783947321.163612:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000044c7969d x1870604235976704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947321.163627:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044c7969d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235976704:0@lo:400: 00010000:00080000:3.0:1783947321.163952:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a294384a x1870604235976960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947321.163963:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a294384a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235976960:0@lo:400: 00000100:00080000:0.0:1783947321.183338:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000e2ef3349 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947321.183476:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b9e0b12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604235976576:12345-0@lo:38: Request processed in 26235us (28571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.183489:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947321.183521:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947321.183530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8156769 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235976832:12345-0@lo:400: 00000100:00100000:0.0:1783947321.183572:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8156769 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235976832:12345-0@lo:400: Request processed in 45us (28477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.183577:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947321.183723:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000142e48ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235976832:0@lo:400: 00000100:00100000:2.0:1783947321.183890:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947321.183900:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783947321.183910:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783947321.183917:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783947321.183919:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000a775ca07 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783947321.183937:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000e6bbd08): req@000000006d55d8f9 x1870604235977088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947321.183961:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c0519f51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604235976576:0@lo:38: 00000100:00100000:3.0:1783947321.184088:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.184123:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e6bbd08 going to sleep for 11 seconds 00000100:00100000:1.0:1783947321.184206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977088 00000100:00100000:1.0:1783947321.184223:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977088 00000100:00100000:1.0:1783947321.184272:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947321.184278:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de57e5c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7820:x1870604235977088:12345-0@lo:1000: 00000100:00100000:1.0:1783947321.184350:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de57e5c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7820:x1870604235977088:12345-0@lo:1000: Request processed in 72us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947321.184356:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947321.184431:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d55d8f9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235977088:0@lo:1000: 00000040:01000000:3.0:1783947321.184484:0:7820:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783947321.184533:0:7820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235977600:0@lo:1000: 00000100:00100000:3.0:1783947321.184564:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.184586:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000304269e4 going to sleep for 11 seconds 00000100:00100000:1.0:1783947321.184635:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977600 00000100:00100000:1.0:1783947321.184639:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977600 00000100:00100000:1.0:1783947321.184665:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947321.184793:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db2edfaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7820:x1870604235977600:12345-0@lo:1000: 00000100:00100000:1.0:1783947321.184894:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db2edfaa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7820:x1870604235977600:12345-0@lo:1000: Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947321.184900:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947321.184967:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235977600:0@lo:1000: 00000100:00100000:3.0:1783947321.185005:0:7820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235977728:0@lo:700: 00000100:00100000:3.0:1783947321.185031:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.185055:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f5be205 going to sleep for 11 seconds 00000100:00100000:1.0:1783947321.185242:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977728 00000100:00100000:1.0:1783947321.185247:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977728 00000100:00100000:1.0:1783947321.185280:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947321.185286:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055f5df84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7820:x1870604235977728:12345-0@lo:700: 00000100:00100000:1.0:1783947321.185331:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055f5df84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7820:x1870604235977728:12345-0@lo:700: Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947321.185336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947321.185395:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235977728:0@lo:700: 00000100:00100000:3.0:1783947321.185584:0:7820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235977856:0@lo:1000: 00000100:00100000:3.0:1783947321.185610:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.185625:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000304269e4 going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.188062:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947321.188089:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235977984:0@lo:41: 00000100:00100000:0.0:1783947321.188170:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947321.188253:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977856 00000100:00100000:0.0:1783947321.188261:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977856 00000100:00100000:0.0:1783947321.188302:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235977984 00000100:00100000:0.0:1783947321.188305:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235977984 00000100:00100000:0.0:1783947321.188322:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947321.188330:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013b24e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7820:x1870604235977856:12345-0@lo:1000: 00000100:00100000:0.0:1783947321.188425:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013b24e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7820:x1870604235977856:12345-0@lo:1000: Request processed in 95us (2813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.188431:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947321.188448:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947321.188452:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0519f51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235977984:12345-0@lo:41: 00000004:00000024:0.0:1783947321.188494:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783947321.188529:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0519f51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235977984:12345-0@lo:41: Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947321.188535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947321.188573:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235977984:0@lo:41: 00000100:00100000:3.0:1783947321.188803:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235977856:0@lo:1000: 00000004:00080000:3.0:1783947321.188875:0:7820:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000001f5be205 with version 0 00000020:00100000:3.0:1783947321.188895:0:7820:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783947321.188902:0:7820:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008dc22482 x1870604235978240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947321.188920:0:7820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235978240:0@lo:1000: 00000100:00100000:3.0:1783947321.188949:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.188971:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set 000000004f45597e going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.189289:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235978240 00000100:00100000:0.0:1783947321.189296:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235978240 00000100:00100000:0.0:1783947321.189336:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947321.189343:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6be14be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7820:x1870604235978240:12345-0@lo:1000: 00000001:00080000:2.0:1783947321.200998:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1783947321.201014:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783947321.201210:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6be14be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7820:x1870604235978240:12345-0@lo:1000: Request processed in 11864us (12257us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783947321.201225:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1783947321.201334:0:7820:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1783947321.201340:0:7820:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783947321.201357:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235978240:0@lo:1000: 00000100:00100000:3.0:1783947321.201498:0:7820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235978368:0@lo:1000: 00000100:00100000:3.0:1783947321.201541:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947321.201576:0:7820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000079d87d3 going to sleep for 11 seconds 00000100:00100000:1.0:1783947321.201649:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235978368 00000100:00100000:1.0:1783947321.201657:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235978368 00000100:00100000:1.0:1783947321.201711:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783947321.201719:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020d4a93b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7820:x1870604235978368:12345-0@lo:1000: 00000100:00100000:1.0:1783947321.201809:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020d4a93b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7820:x1870604235978368:12345-0@lo:1000: Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947321.201816:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947321.201948:0:7820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7820:1870604235978368:0@lo:1000: 00000040:00080000:3.0:1783947321.201966:0:7820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783947321.201995:0:7820:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000001f5be205 with version 1 00000004:00080000:1.0:1783947321.202761:0:7818:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000096639d40 version 1 rpc_version 1 00000020:00100000:1.0:1783947321.202797:0:7818:0:(genops.c:2456:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783947321.202805:0:7818:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000526772b1 x1870604235978624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947321.202823:0:7818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7818:1870604235978624:0@lo:1000: 00000100:00100000:1.0:1783947321.202874:0:7818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947321.202900:0:7818:0:(client.c:2702:ptlrpc_set_wait()) set 000000009209973f going to sleep for 11 seconds 00000100:00100000:0.0:1783947321.202973:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235978624 00000100:00100000:0.0:1783947321.202980:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235978624 00000100:00100000:0.0:1783947321.203014:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947321.203021:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c24851ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7818:x1870604235978624:12345-0@lo:1000: 00000040:00080000:3.0:1783947321.212971:0:7820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783947321.213059:0:7820:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783947321.213065:0:7820:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1783947321.213328:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1783947321.213821:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c24851ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7818:x1870604235978624:12345-0@lo:1000: Request processed in 10796us (10943us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783947321.213837:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1783947321.214132:0:7818:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783947321.214138:0:7818:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783947321.214156:0:7818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000526772b1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7818:1870604235978624:0@lo:1000: 00010000:00010000:1.0:1783947321.523727:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947322.549173:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783947322.768164:0:7870:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947322.770949:0:7870:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947323.571715:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947323.882377:0:7918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1c6e3c40 20000000:00000080:2.0:1783947323.882404:0:7918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7bf7c5b800 uarg=0000000000000000 20000000:01000000:2.0:1783947323.882743:0:7918:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783947323.882754:0:7918:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783947323.882761:0:7918:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783947323.882897:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1783947323.882916:0:7918:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783947323.887411:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947323.887976:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783947323.888022:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1783947323.888045:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1783947323.888067:0:7918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783947323.888089:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947323.888113:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947323.888121:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947323.888148:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947323.888197:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947323.888212:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 17 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947323.888227:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d55d8f9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1870604235978752:0@lo:104: 00000100:00100000:2.0:1783947323.889828:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947323.889978:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947323.890000:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 17 pid: 6503 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947323.890014:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1870604235978880:0@lo:104: 00000100:00100000:2.0:1783947323.890043:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set 00000000450277b8 going to sleep for 11 seconds 00000100:00100000:1.0:1783947323.891439:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783947323.891510:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947323.891544:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235978752 00000100:00100000:1.0:1783947323.891553:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235978752 00000100:00100000:1.0:1783947323.891601:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235978880 00000100:00100000:1.0:1783947323.891604:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235978880 00000100:00100000:1.0:1783947323.891619:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947323.891627:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056c54364 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:7918:x1870604235978752:12345-0@lo:104: 00010000:00010000:1.0:1783947323.892039:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947323.892213:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947323.892220:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056c54364 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:7918:x1870604235978752:12345-0@lo:104: Request processed in 594us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947323.892228:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947323.892306:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947323.892315:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000526772b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:7918:x1870604235978880:12345-0@lo:104: 00010000:00010000:1.0:1783947323.892323:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947323.892412:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d55d8f9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1870604235978752:0@lo:104: 00000100:00100000:2.0:1783947323.892423:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1870604235978880:0@lo:104: 00010000:00010000:2.0:1783947323.892448:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902540:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947323.902560:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902576:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088998405 already unused, calling callback (0000000061d09b67) 10000000:00010000:3.0:1783947323.902580:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902618:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947323.902625:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947323.902631:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947323.902691:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902698:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947323.902728:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902734:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 0000000088998405/0xe6fd1fdb554ffddb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffde2 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902754:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947323.902757:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902763:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000039c7bf69 already unused, calling callback (0000000061d09b67) 10000000:00010000:3.0:1783947323.902765:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902771:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947323.902777:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947323.902787:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947323.902801:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902806:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947323.902810:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902815:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: 0000000039c7bf69/0xe6fd1fdb554ffced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffcf4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.902829:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947323.902831:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947323.902833:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947323.902860:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235979008:0@lo:103: 00000100:00100000:3.0:1783947323.902949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947323.903008:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947323.903015:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005bc9ec7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235979136:0@lo:103: 00000100:00100000:3.0:1783947323.903039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947323.903081:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979008 00000100:00100000:3.0:1783947323.903088:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979008 00010000:00010000:3.0:1783947323.903119:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 18 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947323.903167:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979136 00000100:00100000:3.0:1783947323.903171:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979136 00010000:00010000:3.0:1783947323.903182:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 19 pid: 6503 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947323.903215:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947323.903223:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075fa4743 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:3639:x1870604235979008:12345-0@lo:103: 00010000:00010000:3.0:1783947323.903239:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947323.903244:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 19 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.903255:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 19 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947323.903399:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947323.903408:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084a14091 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:3639:x1870604235979136:12345-0@lo:103: 00010000:00010000:0.0:1783947323.903417:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947323.903420:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 19 pid: 6503 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947323.904189:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783947323.904200:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000526772b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:7918:x1870604235978880:12345-0@lo:104: Request processed in 11886us (12691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947323.904211:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1783947323.904251:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947323.904647:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 19 pid: 6503 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947323.904670:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011741f18/0xe6fd1fdb554ffcf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffced expref: 19 pid: 6503 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947323.904775:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947323.904912:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084a14091 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:3639:x1870604235979136:12345-0@lo:103: Request processed in 1506us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947323.904921:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1783947323.905105:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b26a39f/0xe6fd1fdb554ffde2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffddb expref: 17 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905121:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905140:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905160:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905166:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905172:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905178:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905205:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052decbc7 already unused, calling callback (0000000012aa3ab0) 00010000:00010000:3.0:1783947323.905209:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905217:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905230:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947323.905241:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947323.905368:0:7918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947323.905377:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947323.905382:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000052decbc7/0xe6fd1fdb554ffe75 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947323.906411:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075fa4743 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:3639:x1870604235979008:12345-0@lo:103: Request processed in 3182us (3456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947323.906424:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947323.909557:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005bc9ec7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235979136:0@lo:103: 00000100:00100000:2.0:1783947323.909576:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dc22482 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235979008:0@lo:103: 00000100:00100000:2.0:1783947324.156943:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947324.157071:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604235979264:0@lo:41: 00000100:00100000:2.0:1783947324.157255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947324.157543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979264 00000100:00100000:0.0:1783947324.157553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979264 00000100:00100000:0.0:1783947324.157629:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947324.157639:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d55d8f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604235979264:12345-0@lo:41: 00000004:00000024:0.0:1783947324.158406:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1783947324.158522:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d55d8f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604235979264:12345-0@lo:41: Request processed in 884us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947324.158548:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947324.158624:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001dc67440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604235979264:0@lo:41: 00010000:00010000:1.0:1783947324.599508:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947325.620018:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947326.195770:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947326.195805:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235979392:0@lo:41: 00000100:00100000:0.0:1783947326.195897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.196052:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000682c0041 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235979520:0@lo:400: 00000100:00100000:2.0:1783947326.196062:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fe44f3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235979648:0@lo:400: 00000100:00100000:0.0:1783947326.196311:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007699ac8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235979776:0@lo:400: 00000100:00100000:2.0:1783947326.198752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947326.198881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979648 00000100:00100000:2.0:1783947326.198891:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979648 00000100:00100000:2.0:1783947326.198945:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947326.198953:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000579abef6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235979648:12345-0@lo:400: 00000100:00100000:2.0:1783947326.199021:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000579abef6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235979648:12345-0@lo:400: Request processed in 70us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947326.199028:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947326.199062:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604235979904:0@lo:400: 00000100:00100000:2.0:1783947326.199109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783947326.199175:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fe44f3a8 x1870604235979648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947326.199189:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fe44f3a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235979648:0@lo:400: 00000100:00100000:3.0:1783947326.202082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947326.202322:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979520 00000100:00100000:2.0:1783947326.202334:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979520 00000100:00100000:2.0:1783947326.202407:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947326.202418:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b94c3d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:3639:x1870604235979520:12345-0@lo:400: 00000100:00100000:2.0:1783947326.202550:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b94c3d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:3639:x1870604235979520:12345-0@lo:400: Request processed in 134us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947326.202557:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947326.202643:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000682c0041 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235979520:0@lo:400: 00000100:00100000:0.0:1783947326.203690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979904 00000100:00100000:0.0:1783947326.203705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979904 00000100:00100000:0.0:1783947326.203755:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947326.203763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2542b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604235979904:12345-0@lo:400: 00000100:00100000:0.0:1783947326.204364:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2542b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604235979904:12345-0@lo:400: Request processed in 599us (5251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947326.204373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947326.204404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979392 00000100:00100000:0.0:1783947326.204408:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979392 00000100:00100000:0.0:1783947326.204520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947326.204527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000142e48ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235979392:12345-0@lo:41: 00000004:00000024:0.0:1783947326.204582:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783947326.204627:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000142e48ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235979392:12345-0@lo:41: Request processed in 101us (8730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947326.204634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947326.207425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947326.207700:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9c51fa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235979392:0@lo:41: 00000100:00100000:2.0:1783947326.207826:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235979776 00000100:00100000:2.0:1783947326.207836:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235979776 00000100:00100000:2.0:1783947326.207896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947326.207904:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f53c699b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235979776:12345-0@lo:400: 00000100:00100000:2.0:1783947326.207982:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f53c699b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235979776:12345-0@lo:400: Request processed in 79us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947326.207990:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947326.208056:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007699ac8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235979776:0@lo:400: 00010000:00080000:3.0:1783947326.209926:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000086140a58 x1870604235979904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947326.213184:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086140a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604235979904:0@lo:400: 10000000:01000000:0.0:1783947326.643626:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947326.643638:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be784d800 from 1 10000000:01000000:0.0:1783947326.643644:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947326.643724:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: 00000000204ee8e8/0xe6fd1fdb554ffe7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947326.643772:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: 00000000204ee8e8/0xe6fd1fdb554ffe7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947326.643787:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: 00000000204ee8e8/0xe6fd1fdb554ffe7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947326.643818:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a294384a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980032:0@lo:101: 00000100:00100000:0.0:1783947326.643925:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947326.644008:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 0000000013b9e26c going to sleep for 11 seconds 00000100:00100000:2.0:1783947326.644415:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980032 00000100:00100000:2.0:1783947326.644425:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980032 00000100:00100000:2.0:1783947326.644519:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783947326.644529:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000141bdc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235980032:12345-0@lo:101: 00010000:00010000:2.0:1783947326.644546:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947326.644563:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a820d56/0xe6fd1fdb554ffe83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffe7c expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947326.644589:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a820d56/0xe6fd1fdb554ffe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947326.644598:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a820d56/0xe6fd1fdb554ffe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947326.644607:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a820d56, rc 0) 00000100:00100000:2.0:1783947326.644654:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000141bdc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235980032:12345-0@lo:101: Request processed in 127us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947326.644660:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:1.0:1783947326.644956:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947326.644988:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a294384a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980032:0@lo:101: 00010000:00010000:1.0:1783947326.645004:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: 00000000204ee8e8/0xe6fd1fdb554ffe7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947326.645013:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: 00000000204ee8e8/0xe6fd1fdb554ffe7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947326.645121:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000040f3a0e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980160:0@lo:501: 00000100:00100000:1.0:1783947326.645156:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947326.645189:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bd4f8e8 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.645307:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980160 00000100:00100000:3.0:1783947326.645313:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980160 00000100:00100000:3.0:1783947326.645523:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783947326.645531:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ea8c207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235980160:12345-0@lo:501: 00000100:00100000:3.0:1783947326.645678:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ea8c207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235980160:12345-0@lo:501: Request processed in 148us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.645686:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783947326.645733:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000040f3a0e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980160:0@lo:501: 00000100:00100000:3.0:1783947326.645786:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001e082dff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980288:0@lo:503: 00000100:00100000:3.0:1783947326.645831:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.645858:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f9716c9 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.645872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980288 00000100:00100000:3.0:1783947326.645876:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980288 00000100:00100000:3.0:1783947326.645900:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783947326.645906:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe66523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235980288:12345-0@lo:503: 00000100:00100000:3.0:1783947326.645992:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe66523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235980288:12345-0@lo:503: Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.646000:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783947326.646040:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001e082dff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980288:0@lo:503: 00000100:00100000:3.0:1783947326.646300:0:8037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001e082dff pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8037:1870604235980416:0@lo:502: 00000100:00100000:3.0:1783947326.646347:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.646367:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980416 00000100:00100000:3.0:1783947326.646371:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980416 00000100:00100000:3.0:1783947326.646391:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783947326.646395:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025874cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8037:x1870604235980416:12345-0@lo:502: 00000100:00100000:3.0:1783947326.646495:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025874cab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8037:x1870604235980416:12345-0@lo:502: Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.646501:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783947326.646527:0:8037:0:(client.c:2702:ptlrpc_set_wait()) set 0000000035749835 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.646538:0:8037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001e082dff pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8037:1870604235980416:0@lo:502: 00000020:01000000:3.0:1783947326.646558:0:8037:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947326.646568:0:8037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947326.646570:0:8037:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783947326.646582:0:8037:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7be784d800 00000020:00000080:3.0:1783947326.646584:0:8037:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947326.646629:0:8037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8037:1870604235980544:0@lo:502: 00000100:00100000:3.0:1783947326.646662:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.646681:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980544 00000100:00100000:3.0:1783947326.646684:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980544 00000100:00100000:3.0:1783947326.646705:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783947326.646712:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8037:x1870604235980544:12345-0@lo:502: 00000100:00100000:3.0:1783947326.646766:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8037:x1870604235980544:12345-0@lo:502: Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.646772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783947326.646798:0:8037:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa88000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.646809:0:8037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8037:1870604235980544:0@lo:502: 00000020:01000000:3.0:1783947326.646825:0:8037:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947326.646829:0:8037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947326.646830:0:8037:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783947326.646834:0:8037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1783947326.646894:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783947326.646914:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947326.646923:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947326.646934:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947326.646945:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947326.646948:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc9511800 from 1 10000000:01000000:3.0:1783947326.646951:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947326.646975:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947326.646988:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947326.647000:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947326.647013:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980672:0@lo:101: 00000100:00100000:3.0:1783947326.647041:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.647053:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa88000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.647066:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980672 00000100:00100000:3.0:1783947326.647070:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980672 00000100:00100000:3.0:1783947326.647106:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783947326.647113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235980672:12345-0@lo:101: 00010000:00010000:3.0:1783947326.647123:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947326.647137:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffe8a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947326.647158:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947326.647168:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947326.647176:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:3.0:1783947326.647201:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235980672:12345-0@lo:101: Request processed in 89us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.647207:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783947326.647236:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980672:0@lo:101: 00010000:00010000:3.0:1783947326.647253:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947326.647261:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947326.647303:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980800:0@lo:501: 00000100:00100000:3.0:1783947326.647325:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.647336:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa88000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.647346:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980800 00000100:00100000:3.0:1783947326.647348:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980800 00000100:00100000:3.0:1783947326.647367:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947326.647372:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235980800:12345-0@lo:501: 00000100:00100000:3.0:1783947326.647485:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235980800:12345-0@lo:501: Request processed in 84us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.647491:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947326.647521:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980800:0@lo:501: 00000100:00100000:3.0:1783947326.647546:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980928:0@lo:503: 00000100:00100000:3.0:1783947326.647579:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.647592:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa88000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.647602:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235980928 00000100:00100000:3.0:1783947326.647605:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235980928 00000100:00100000:3.0:1783947326.647625:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783947326.647630:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235980928:12345-0@lo:503: 00000100:00100000:3.0:1783947326.647699:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235980928:12345-0@lo:503: Request processed in 68us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.647705:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783947326.647743:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235980928:0@lo:503: 00000100:00100000:3.0:1783947326.648012:0:8038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8038:1870604235981056:0@lo:502: 00000100:00100000:3.0:1783947326.648047:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.648067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981056 00000100:00100000:3.0:1783947326.648071:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981056 00000100:00100000:3.0:1783947326.648108:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783947326.648114:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8038:x1870604235981056:12345-0@lo:502: 00000100:00100000:3.0:1783947326.648185:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8038:x1870604235981056:12345-0@lo:502: Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.648192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783947326.648233:0:8038:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa886c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.648244:0:8038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8038:1870604235981056:0@lo:502: 00000020:01000000:3.0:1783947326.648262:0:8038:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947326.648269:0:8038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947326.648271:0:8038:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783947326.648276:0:8038:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bc9511800 00000020:00000080:3.0:1783947326.648278:0:8038:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947326.648297:0:8038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8038:1870604235981184:0@lo:502: 00000100:00100000:3.0:1783947326.648332:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947326.648349:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981184 00000100:00100000:3.0:1783947326.648352:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981184 00000100:00100000:3.0:1783947326.648370:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783947326.648375:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8038:x1870604235981184:12345-0@lo:502: 00000100:00100000:3.0:1783947326.648435:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8038:x1870604235981184:12345-0@lo:502: Request processed in 59us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947326.648442:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783947326.648531:0:8038:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa886c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947326.648549:0:8038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8038:1870604235981184:0@lo:502: 00000020:01000000:3.0:1783947326.648566:0:8038:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947326.648570:0:8038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947326.648572:0:8038:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783947326.648575:0:8038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1783947326.648656:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783947326.648680:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947326.648690:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947326.648701:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947327.670923:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947328.691805:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947329.268849:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235981312:0@lo:41: 00000100:00100000:0.0:1783947329.268957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947329.269397:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981312 00000100:00100000:2.0:1783947329.269407:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981312 00000100:00100000:2.0:1783947329.269507:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947329.269521:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235981312:12345-0@lo:41: 00000004:00000024:2.0:1783947329.269569:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1783947329.269625:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235981312:12345-0@lo:41: Request processed in 107us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947329.269650:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947329.271044:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235981312:0@lo:41: 00010000:00010000:2.0:1783947329.715688:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947330.743694:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947331.316855:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947331.316883:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235981440:0@lo:41: 00000100:00100000:2.0:1783947331.316957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947331.317043:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235981824:0@lo:400: 00000100:00100000:0.0:1783947331.317057:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235981568:0@lo:400: 00000100:00100000:2.0:1783947331.317068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947331.317101:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947331.317105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947331.317110:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604235981952:0@lo:400: 00000100:00100000:0.0:1783947331.317136:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947331.317141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947331.317145:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604235981696:0@lo:400: 00000100:00100000:0.0:1783947331.317173:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947331.317175:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981440 00000100:00100000:2.0:1783947331.317182:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981440 00000100:00100000:2.0:1783947331.317221:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981824 00000100:00100000:2.0:1783947331.317223:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981824 00000100:00100000:2.0:1783947331.317236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947331.317244:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235981440:12345-0@lo:41: 00000004:00000024:2.0:1783947331.317280:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1783947331.317314:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981568 00000100:00100000:3.0:1783947331.317320:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981568 00000100:00100000:2.0:1783947331.317336:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235981440:12345-0@lo:41: Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947331.317343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947331.317363:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947331.317367:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947331.317372:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235981824:12345-0@lo:400: 00000100:00100000:3.0:1783947331.317378:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:3637:x1870604235981568:12345-0@lo:400: 00000100:00100000:2.0:1783947331.317408:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235981824:12345-0@lo:400: Request processed in 37us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947331.317415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947331.317429:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:3637:x1870604235981568:12345-0@lo:400: Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947331.317435:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981952 00000100:00100000:3.0:1783947331.317438:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947331.317440:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981952 00000100:00100000:2.0:1783947331.317496:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235981696 00000100:00100000:2.0:1783947331.317499:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235981696 00000100:00100000:2.0:1783947331.317514:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783947331.317521:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235981568:0@lo:400: 00000100:00100000:3.0:1783947331.317555:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783947331.317563:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783947331.317650:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947331.317656:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604235981696:12345-0@lo:400: 00000100:00100000:3.0:1783947331.317686:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604235981696:12345-0@lo:400: Request processed in 31us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947331.317692:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783947331.317716:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7beeeea300 x1870604235981696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947331.317728:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604235981696:0@lo:400: 00000100:00100000:2.0:1783947331.317908:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604235981952:12345-0@lo:400: 00000100:00100000:2.0:1783947331.317940:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604235981952:12345-0@lo:400: Request processed in 421us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947331.317947:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783947331.326675:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7beeee8a80 x1870604235981952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947331.326715:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604235981952:0@lo:400: 00000100:00100000:0.0:1783947331.326735:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235981824:0@lo:400: 00000100:00100000:0.0:1783947331.326758:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235981440:0@lo:41: 00010000:00010000:1.0:1783947331.766299:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947332.787620:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783947333.773223:0:8420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783947333.773228:0:8420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783947333.773229:0:8420:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783947333.773381:0:8420:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7bff958800 00000020:01000004:3.0:1783947333.773405:0:8420:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783947333.773419:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783947333.773437:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e7bc55119c0) 00000020:00000080:3.0:1783947333.773482:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1783947333.817581:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1783947333.849694:0:8420:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783947333.850287:0:8420:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1783947333.875746:0:8420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783947333.875982:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783947333.875996:0:8420:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783947333.876010:0:8420:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6fd1fdb554ffe9f 00000020:01000004:3.0:1783947333.876019:0:8420:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783947333.879002:0:8420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783947333.879009:0:8420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783947333.879020:0:8420:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783947333.879029:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783947333.879234:0:8420:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e7bf7f73380) 00000020:00000080:3.0:1783947333.879255:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1783947333.881008:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947333.882231:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783947333.882240:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783947333.887250:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947333.887266:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783947333.893389:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783947333.893403:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783947333.902707:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947333.902992:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783947333.902999:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783947333.904131:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783947333.904141:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783947333.958301:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947333.958684:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783947333.958692:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783947333.962994:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947333.963020:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783947333.968672:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783947333.968688:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783947333.973099:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947333.973306:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783947333.973313:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783947333.980441:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783947333.980490:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1783947334.041312:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947334.041612:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1783947334.041619:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1783947334.043081:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1783947334.043102:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783947334.045844:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783947334.045887:0:8420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1783947334.045896:0:8420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783947334.077865:0:8420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783947334.077909:0:8420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783947334.077914:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783947334.077916:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783947334.077918:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947334.077919:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947334.077921:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947334.077922:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947334.077924:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947334.077926:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947334.077928:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947334.077930:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947334.077932:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783947334.077948:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783947334.077956:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783947334.077957:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783947334.077958:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947334.077958:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947334.077959:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947334.077960:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947334.077961:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947334.077962:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947334.077963:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947334.077964:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947334.077964:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783947334.077994:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783947334.078017:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235982080:0@lo:253: 00000100:00100000:3.0:1783947334.079205:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.079330:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947334.081669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982080 00000100:00100000:0.0:1783947334.081686:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982080 00000100:00100000:2.0:1783947334.088971:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947334.088989:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8420:x1870604235982080:12345-0@lo:253: 20000000:01000000:2.0:1783947334.089058:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783947334.089063:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1783947334.089069:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1783947334.089073:0:6505:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1783947334.089387:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947334.089659:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1783947334.089677:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1783947334.089695:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1783947334.089701:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1783947334.089713:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1783947334.089729:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1783947334.089824:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1783947334.089840:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:2.0:1783947334.089842:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:2.0:1783947334.089857:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1783947334.089863:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783947334.089885:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1783947334.089897:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:2.0:1783947334.089912:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1783947334.089918:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783947334.089930:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1783947334.089958:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1783947334.090030:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1783947334.090040:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:2.0:1783947334.090042:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:2.0:1783947334.090054:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1783947334.090058:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783947334.090068:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1783947334.090072:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:2.0:1783947334.090084:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1783947334.090089:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783947334.090122:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1783947334.090154:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1783947334.091420:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1783947334.091447:0:6505:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:2.0:1783947334.091449:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:2.0:1783947334.091530:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1783947334.091538:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783947334.091552:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1783947334.091557:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:2.0:1783947334.091571:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1783947334.091578:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783947334.092199:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1783947334.092222:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1783947334.092238:0:6505:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783947334.092242:0:6505:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783947334.092245:0:6505:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783947334.092293:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783947334.092307:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783947334.093382:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1783947334.093416:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1783947334.093432:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783947334.094080:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1783947334.094104:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1783947334.094117:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1783947334.094125:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783947334.094128:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783947334.094497:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1783947334.094536:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1783947334.094553:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1783947334.094923:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1783947334.094956:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1783947334.094970:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1783947334.094980:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783947334.094982:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783947334.095267:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783947334.095885:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783947334.095908:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783947334.095922:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1783947334.095931:0:6505:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783947334.095933:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783947334.096229:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1783947334.096253:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1783947334.096268:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1783947334.096434:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1783947334.096453:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1783947334.096637:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1783947334.096654:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783947334.096678:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096698:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb554ffd79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096706:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb554ffdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096712:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb554ffe28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096718:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c021c2600/0xe6fd1fdb554ffe44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096737:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bc0030000/0xe6fd1fdb554ffe6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096744:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096789:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bc0030000/0xe6fd1fdb554ffe6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096804:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bc0030000/0xe6fd1fdb554ffe6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.096821:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982208:0@lo:104: 00000100:00100000:2.0:1783947334.096886:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947334.096977:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c021c2600/0xe6fd1fdb554ffe44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.096986:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c021c2600/0xe6fd1fdb554ffe44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.096994:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982336:0@lo:104: 00000100:00100000:2.0:1783947334.097013:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947334.097082:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb554ffe28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.097091:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb554ffe28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.097099:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982464:0@lo:104: 00000100:00100000:2.0:1783947334.097127:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.097179:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982208 00000100:00100000:1.0:1783947334.097186:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982208 00000100:00100000:1.0:1783947334.097221:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982336 00000100:00100000:1.0:1783947334.097224:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982336 00000100:00100000:1.0:1783947334.097237:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947334.097247:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6505:x1870604235982208:12345-0@lo:104: 00010000:00010000:1.0:1783947334.097260:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097326:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947334.097333:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6505:x1870604235982208:12345-0@lo:104: Request processed in 88us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.097341:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947334.097359:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947334.097365:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235982336:12345-0@lo:104: 00010000:00010000:1.0:1783947334.097373:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097407:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947334.097412:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235982336:12345-0@lo:104: Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.097418:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1783947334.097436:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947334.097442:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097450:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bc0031e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947334.097476:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097485:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947334.097494:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947334.097499:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947334.097538:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097545:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947334.097565:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097574:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb554ffe67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe6e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097588:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947334.097592:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097597:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947334.097600:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097607:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947334.097612:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947334.097617:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947334.097631:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097636:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947334.097641:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097655:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f800/0xe6fd1fdb554ffe3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.097664:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947334.097666:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947334.097667:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947334.097689:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235982592:0@lo:103: 00000100:00100000:1.0:1783947334.097719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.097746:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947334.097752:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235982720:0@lo:103: 00000100:00100000:1.0:1783947334.097773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.097801:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982592 00000100:00100000:1.0:1783947334.097953:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982592 00010000:00010000:1.0:1783947334.097976:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bc0030000/0xe6fd1fdb554ffe6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 19 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.098000:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982720 00000100:00100000:1.0:1783947334.098003:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982720 00010000:00010000:1.0:1783947334.098013:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c021c2600/0xe6fd1fdb554ffe44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 20 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.098033:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947334.098039:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3637:x1870604235982592:12345-0@lo:103: 00010000:00010000:1.0:1783947334.098049:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947334.098054:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bc0030000/0xe6fd1fdb554ffe6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 20 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.098065:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bc0030000/0xe6fd1fdb554ffe6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 20 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.098093:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947334.098125:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3637:x1870604235982592:12345-0@lo:103: Request processed in 86us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.098133:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947334.098149:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947334.098155:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:3637:x1870604235982720:12345-0@lo:103: 00010000:00010000:1.0:1783947334.098162:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947334.098167:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c021c2600/0xe6fd1fdb554ffe44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 19 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.098175:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c021c2600/0xe6fd1fdb554ffe44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 19 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.098184:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947334.098207:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:3637:x1870604235982720:12345-0@lo:103: Request processed in 52us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.098213:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947334.098260:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235982720:0@lo:103: 00000100:00100000:1.0:1783947334.098270:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235982592:0@lo:103: 00010000:00010000:3.0:1783947334.098359:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947334.098528:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb554ffdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.098538:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb554ffdf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 18 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.098548:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982848:0@lo:104: 00000100:00100000:2.0:1783947334.098575:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947334.098591:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb554ffd79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.098598:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb554ffd79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 18 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.098606:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982976:0@lo:104: 00000100:00100000:2.0:1783947334.098622:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947334.098629:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffb8b900 going to sleep for 11 seconds 00010000:00010000:2.0:1783947334.098641:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bc0030000/0xe6fd1fdb554ffe6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe67 expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.098651:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982208:0@lo:104: 00010000:00010000:2.0:1783947334.098659:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c2600/0xe6fd1fdb554ffe44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe3d expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.098667:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982336:0@lo:104: 00000100:00100000:1.0:1783947334.098772:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982464 00000100:00100000:1.0:1783947334.098777:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982464 00000100:00100000:1.0:1783947334.098797:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982848 00000100:00100000:1.0:1783947334.098800:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982848 00000100:00100000:1.0:1783947334.098809:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235982976 00000100:00100000:1.0:1783947334.098812:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235982976 00000100:00100000:1.0:1783947334.098824:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947334.098829:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:6505:x1870604235982464:12345-0@lo:104: 00010000:00010000:1.0:1783947334.098848:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.098933:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947334.098949:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:6505:x1870604235982464:12345-0@lo:104: Request processed in 119us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.098956:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947334.098971:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947334.098978:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6505:x1870604235982848:12345-0@lo:104: 00010000:00010000:1.0:1783947334.098986:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.099064:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982464:0@lo:104: 00000100:00100000:2.0:1783947334.099072:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982848:0@lo:104: 00010000:00010000:3.0:1783947334.099148:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947334.099155:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099162:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c2e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947334.099166:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099173:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947334.099180:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947334.099192:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947334.099227:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099234:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783947334.099283:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235983104:0@lo:103: 00000100:00100000:2.0:1783947334.099314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947334.099358:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099366:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2e00/0xe6fd1fdb554ffe21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099377:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947334.099380:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099385:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c2200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947334.099388:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099394:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947334.099400:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947334.099404:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783947334.099420:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.099425:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783947334.101643:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235983104 00000100:00100000:0.0:1783947334.101661:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235983104 00010000:00010000:0.0:1783947334.101710:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb554ffe28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947334.101762:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947334.101773:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3639:x1870604235983104:12345-0@lo:103: 00010000:00010000:0.0:1783947334.101792:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947334.101819:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb554ffe28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947334.101832:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb554ffe28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947334.101852:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb554ffe28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe21 expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947334.101871:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947334.103798:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1783947334.103819:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6505:x1870604235982848:12345-0@lo:104: Request processed in 4836us (5237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.103833:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1783947334.103908:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947334.103922:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947334.103948:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235982976:12345-0@lo:104: 00010000:00010000:1.0:1783947334.103967:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104060:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947334.104065:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6505:x1870604235982976:12345-0@lo:104: Request processed in 137us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.104072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1783947334.104088:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947334.104106:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104114:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c02052800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947334.104118:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104127:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947334.104135:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947334.104141:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947334.104183:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104190:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947334.104208:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104217:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb554ffd72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffd79 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104231:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947334.104233:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947334.104235:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947334.104244:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947334.104262:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235983360:0@lo:103: 00000100:00100000:1.0:1783947334.104305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.104350:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235983360 00000100:00100000:1.0:1783947334.104364:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235983360 00010000:00010000:1.0:1783947334.104389:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb554ffd79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 17 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.104414:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947334.104422:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3638:x1870604235983360:12345-0@lo:103: 00010000:00010000:1.0:1783947334.104432:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947334.104437:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb554ffd79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 17 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104447:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb554ffd79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 17 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.104488:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947334.104515:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3638:x1870604235983360:12345-0@lo:103: Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.104522:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947334.104560:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235983360:0@lo:103: 00010000:00010000:1.0:1783947334.104625:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb554ffd79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffd72 expref: 16 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.104637:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1870604235982976:0@lo:104: 00010000:00010000:1.0:1783947334.104664:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.104803:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.104812:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2200/0xe6fd1fdb554ffde9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffdf0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.104826:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947334.104828:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947334.104830:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947334.104843:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235983232:0@lo:103: 00000100:00100000:3.0:1783947334.104872:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.109840:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235983232 00000100:00100000:1.0:1783947334.109861:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235983232 00010000:00010000:1.0:1783947334.109921:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb554ffdf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 16 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.109999:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947334.110008:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc6499850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:3640:x1870604235983232:12345-0@lo:103: 00010000:00010000:1.0:1783947334.110025:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947334.110031:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb554ffdf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 16 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110044:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb554ffdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 16 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110065:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb554ffdf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffde9 expref: 16 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110084:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110093:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110113:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110120:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110127:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110134:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110151:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947334.110156:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110166:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110184:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110196:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947334.110280:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc6499850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3640:x1870604235983232:12345-0@lo:103: Request processed in 273us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.110288:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947334.110340:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235983232:0@lo:103: 00010000:00010000:1.0:1783947334.110369:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110378:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.110385:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb554ffead lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783947334.110399:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783947334.111500:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:3639:x1870604235983104:12345-0@lo:103: Request processed in 9722us (12177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947334.111512:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947334.113023:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:8420:x1870604235982080:12345-0@lo:253: Request processed in 24032us (33814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.113037:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783947334.113190:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235982080:0@lo:253: 10000000:01000000:0.0:1783947334.113212:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783947334.113216:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947334.113217:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783947334.113219:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947334.113220:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1783947334.113221:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947334.113223:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947334.113224:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947334.113226:0:8420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783947334.113228:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947334.113230:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783947334.113253:0:8420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7bff958800 from lustre-OST0000 10000000:01000000:0.0:1783947334.113290:0:8420:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783947334.113293:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783947334.113303:0:8420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7bc5510000 local copy 10000000:01000000:0.0:1783947334.113309:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783947334.113350:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947334.113379:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947334.113390:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947334.113414:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235983488:0@lo:101: 00000100:00100000:2.0:1783947334.115326:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235983104:0@lo:103: 00000100:00100000:0.0:1783947334.116022:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947334.116087:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947334.116152:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235983488 00000100:00100000:3.0:1783947334.116162:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235983488 00000100:00100000:3.0:1783947334.116228:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783947334.116239:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+13:8420:x1870604235983488:12345-0@lo:101: 00010000:00010000:3.0:1783947334.116260:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947334.116285:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554ffebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffeb4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.116315:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554ffebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffeb4 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.116328:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554ffebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffeb4 expref: 14 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.116338:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96800, rc 0) 00000100:00100000:3.0:1783947334.116410:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235983488:12345-0@lo:101: Request processed in 173us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.116431:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947334.116641:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235983488:0@lo:101: 00010000:00010000:1.0:1783947334.116662:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.116683:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.116836:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235983616:0@lo:501: 00000100:00100000:1.0:1783947334.116873:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.116906:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc76d1300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947334.117089:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235983616 00000100:00100000:3.0:1783947334.117095:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235983616 00000100:00100000:3.0:1783947334.117135:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783947334.117143:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235983616:12345-0@lo:501: 00000100:00100000:3.0:1783947334.117222:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235983616:12345-0@lo:501: Request processed in 80us (348us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947334.117230:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783947334.117275:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235983616:0@lo:501: 10000000:01000000:2.0:1783947334.117293:0:8420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783947334.117333:0:8420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783947334.117341:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.117351:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.117357:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.117384:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947334.117413:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947334.117421:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947334.117423:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7bff958800 10000000:01000000:2.0:1783947334.117431:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783947334.117434:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b400 already unused, calling callback (ffffffffc11fcc20) 10000000:01000000:2.0:1783947334.117439:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:00010000:1.0:1783947334.117439:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947334.117444:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947334.117452:0:8420:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783947334.117478:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783947334.117505:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.117525:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.117533:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.120370:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947334.120392:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947334.120399:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947334.120467:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.120476:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947334.120507:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.120516:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b400/0xe6fd1fdb554ffeb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554ffebb expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.120550:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947334.120553:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947334.120555:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947334.120571:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947334.120594:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235983872:0@lo:103: 00000100:00100000:1.0:1783947334.121294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.121527:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235983744:0@lo:101: 00000100:00100000:1.0:1783947334.121562:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.121587:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc76d1300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947334.121728:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235983744 00000100:00100000:3.0:1783947334.121740:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235983744 00000100:00100000:3.0:1783947334.121814:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783947334.121825:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235983744:12345-0@lo:101: 00010000:00010000:3.0:1783947334.121845:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947334.121866:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffec2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.121898:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.121910:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.121921:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96400, rc 0) 00000100:00100000:3.0:1783947334.121976:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235983744:12345-0@lo:101: Request processed in 153us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.121984:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783947334.122065:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235983872 00000100:00100000:2.0:1783947334.122071:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235983872 00000100:00100000:2.0:1783947334.122160:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947334.122171:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3637:x1870604235983872:12345-0@lo:103: 00010000:00010000:2.0:1783947334.122183:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947334.122201:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554ffebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb554ffeb4 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.122217:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947334.122259:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:3637:x1870604235983872:12345-0@lo:103: Request processed in 90us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.122266:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947334.122334:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235983744:0@lo:101: 00010000:00010000:1.0:1783947334.122350:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.122358:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.122488:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984000:0@lo:501: 00000100:00100000:1.0:1783947334.122519:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.122553:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc76d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947334.122622:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235983872:0@lo:103: 00000100:00100000:3.0:1783947334.122755:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984000 00000100:00100000:3.0:1783947334.122760:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984000 00000100:00100000:3.0:1783947334.122808:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783947334.122816:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984000:12345-0@lo:501: 00000100:00100000:3.0:1783947334.122928:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984000:12345-0@lo:501: Request processed in 113us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.122949:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783947334.123010:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4747800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984000:0@lo:501: 00000100:00100000:0.0:1783947334.123039:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984128:0@lo:503: 00000100:00100000:0.0:1783947334.123078:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947334.123104:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947334.123161:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984128 00000100:00100000:1.0:1783947334.123165:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984128 00000100:00100000:1.0:1783947334.123197:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947334.123204:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984128:12345-0@lo:503: 00000100:00100000:1.0:1783947334.123287:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984128:12345-0@lo:503: Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.123293:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947334.123338:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984128:0@lo:503: 00000040:00080000:1.0:1783947334.123747:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947334.123834:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4747100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984256:0@lo:502: 00000100:00100000:1.0:1783947334.123874:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.123889:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7beee83840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947334.123913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984256 00000100:00100000:1.0:1783947334.123917:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984256 00000100:00100000:1.0:1783947334.123949:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783947334.123955:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984256:12345-0@lo:502: 00000100:00100000:1.0:1783947334.124028:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984256:12345-0@lo:502: Request processed in 72us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.124035:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783947334.124069:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4747100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984256:0@lo:502: 00000040:00080000:1.0:1783947334.124281:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783947334.124304:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783947334.124314:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783947334.124325:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783947334.124335:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783947334.124345:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783947334.124363:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4747100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984384:0@lo:502: 00000100:00100000:1.0:1783947334.124392:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.124423:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7beee83840 going to sleep for 11 seconds 00000100:00100000:2.0:1783947334.124502:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984384 00000100:00100000:2.0:1783947334.124507:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984384 00000100:00100000:2.0:1783947334.124538:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783947334.124546:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984384:12345-0@lo:502: 00000100:00100000:2.0:1783947334.124631:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984384:12345-0@lo:502: Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.124640:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783947334.124650:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4747100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984384:0@lo:502: 00000040:00080000:0.0:1783947334.124696:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783947334.124703:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1783947334.128598:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783947334.128612:0:8443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1783947334.128622:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947334.128624:0:8443:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1783947334.128632:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947334.128653:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e7bf7f70000) 00000020:00000080:3.0:1783947334.128683:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783947334.128690:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783947334.128798:0:8443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bff958800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1783947334.128808:0:8443:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783947334.128816:0:8443:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6fd1fdb554ffed7 00010000:00010000:2.0:1783947334.143109:0:8443:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1783947334.143415:0:8443:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783947334.147446:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783947334.147891:0:8443:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783947334.154507:0:8443:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783947334.154717:0:8443:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1783947334.166386:0:8443:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1783947334.172033:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783947334.172050:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947334.172059:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947334.172062:0:8443:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783947334.172065:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947334.172071:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947334.172072:0:8443:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783947334.172075:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783947334.172077:0:8443:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783947334.172108:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947334.172111:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947334.172113:0:8443:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783947334.172117:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783947334.176137:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1783947334.183718:0:8420:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783947334.183756:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.183773:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947334.183801:0:8420:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bff958800 from 1 10000000:01000000:1.0:1783947334.183804:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947334.183861:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.183870:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.183880:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947334.183910:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984512:0@lo:101: 00000100:00100000:1.0:1783947334.183992:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.184052:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7beee83cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947334.190573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984512 00000100:00100000:2.0:1783947334.190590:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984512 00000100:00100000:2.0:1783947334.190763:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783947334.190775:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:8420:x1870604235984512:12345-0@lo:101: 00010000:00010000:2.0:1783947334.190796:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947334.190820:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffede expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.190852:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.190864:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.190874:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f600, rc 0) 00000100:00100000:2.0:1783947334.191069:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235984512:12345-0@lo:101: Request processed in 296us (7076us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.191076:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783947334.191285:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984512:0@lo:101: 00010000:00010000:0.0:1783947334.191309:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947334.191319:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.192007:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984640:0@lo:501: 00000100:00100000:2.0:1783947334.192055:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947334.192099:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffb8b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947334.192154:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984640 00000100:00100000:3.0:1783947334.192161:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984640 00000100:00100000:3.0:1783947334.192291:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783947334.192301:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235984640:12345-0@lo:501: 00000100:00100000:2.0:1783947334.192529:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984640:0@lo:501: 00000100:00100000:2.0:1783947334.192565:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984768:0@lo:503: 00000100:00100000:2.0:1783947334.192602:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947334.192621:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffb8b600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947334.192713:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984768 00000100:00100000:2.0:1783947334.192717:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984768 00000100:00100000:2.0:1783947334.192741:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947334.192748:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235984768:12345-0@lo:503: 00000100:00100000:2.0:1783947334.192829:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235984768:12345-0@lo:503: Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.192843:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947334.192890:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984768:0@lo:503: 00000040:00080000:2.0:1783947334.193409:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947334.193544:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235984640:12345-0@lo:501: Request processed in 1243us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.193553:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783947334.193851:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984896:0@lo:502: 00000100:00100000:2.0:1783947334.193895:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947334.193929:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffb8b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947334.193992:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235984896 00000100:00100000:3.0:1783947334.193998:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235984896 00000100:00100000:3.0:1783947334.194036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783947334.194045:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235984896:12345-0@lo:502: 00000100:00100000:3.0:1783947334.194287:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235984896:12345-0@lo:502: Request processed in 243us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.194293:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783947334.195715:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235984896:0@lo:502: 00000040:00080000:1.0:1783947334.196106:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783947334.196143:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783947334.196268:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985024:0@lo:502: 00000100:00100000:1.0:1783947334.196354:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.196487:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7beee83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947334.196775:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985024 00000100:00100000:0.0:1783947334.196784:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985024 00000100:00100000:0.0:1783947334.196870:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783947334.196881:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235985024:12345-0@lo:502: 00000100:00100000:0.0:1783947334.197047:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235985024:12345-0@lo:502: Request processed in 167us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947334.197054:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783947334.197139:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985024:0@lo:502: 00000040:00080000:1.0:1783947334.197213:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783947334.197225:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783947334.197882:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947334.197896:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947334.197899:0:8447:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783947334.197906:0:8447:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bff958800 00000020:00000080:1.0:1783947334.197910:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947334.197922:0:8447:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947334.197943:0:8447:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947334.197944:0:8447:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783947334.197947:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783947334.198072:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783947334.198098:0:8420:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947334.198121:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.198133:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947334.198191:0:8420:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783947334.198195:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7bff958800 10000000:01000000:3.0:1783947334.198199:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7bff958800 10000000:01000000:3.0:1783947334.198204:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783947334.198210:0:8420:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bff958800 from 1 10000000:01000000:3.0:1783947334.198213:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783947334.198250:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.198268:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.198279:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947334.198302:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985152:0@lo:101: 00000100:00100000:3.0:1783947334.198354:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.198807:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1783947334.198894:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985152 00000100:00100000:2.0:1783947334.198903:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985152 00000100:00100000:2.0:1783947334.198961:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783947334.198971:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8420:x1870604235985152:12345-0@lo:101: 00010000:00010000:2.0:1783947334.198989:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947334.199006:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554ffeec expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.199036:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.199048:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.199057:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e200, rc 0) 00000100:00100000:2.0:1783947334.199160:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985152:12345-0@lo:101: Request processed in 191us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.199168:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947334.199369:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985152:0@lo:101: 00010000:00010000:3.0:1783947334.199387:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.199396:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947334.199609:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985280:0@lo:501: 00000100:00100000:3.0:1783947334.199802:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.199865:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947334.199911:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985280 00000100:00100000:1.0:1783947334.199917:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985280 00000100:00100000:2.0:1783947334.199973:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783947334.199983:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985280:12345-0@lo:501: 00000100:00100000:2.0:1783947334.200102:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985280:12345-0@lo:501: Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.200115:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783947334.200265:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985280:0@lo:501: 00000100:00100000:3.0:1783947334.200300:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985408:0@lo:503: 00000100:00100000:3.0:1783947334.200340:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.200362:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947334.200412:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985408 00000100:00100000:0.0:1783947334.200554:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985408 00000100:00100000:0.0:1783947334.200595:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783947334.200604:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985408:12345-0@lo:503: 00000100:00100000:0.0:1783947334.200788:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985408:12345-0@lo:503: Request processed in 185us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947334.200795:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783947334.200876:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985408:0@lo:503: 00000040:00080000:3.0:1783947334.201144:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947334.201234:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985536:0@lo:502: 00000100:00100000:3.0:1783947334.201271:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.201304:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947334.201440:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985536 00000100:00100000:0.0:1783947334.201446:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985536 00000100:00100000:0.0:1783947334.201502:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783947334.201510:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985536:12345-0@lo:502: 00000100:00100000:0.0:1783947334.201591:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985536:12345-0@lo:502: Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947334.201600:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783947334.202122:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985536:0@lo:502: 00000040:00080000:3.0:1783947334.202339:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783947334.202366:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783947334.202378:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783947334.202388:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783947334.202400:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783947334.202412:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783947334.202438:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783947334.202491:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783947334.202505:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783947334.202517:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783947334.202528:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783947334.202538:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783947334.202548:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783947334.202558:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783947334.202567:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783947334.202577:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783947334.202587:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783947334.202596:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783947334.202606:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783947334.202616:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783947334.202625:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783947334.202840:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783947334.202853:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783947334.202875:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783947334.202887:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783947334.202898:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783947334.202909:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783947334.202928:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783947334.202952:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783947334.202964:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783947334.202973:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783947334.202983:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783947334.202993:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783947334.203003:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783947334.203013:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783947334.203023:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783947334.203035:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1783947334.203075:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985664:0@lo:502: 00000100:00100000:3.0:1783947334.203135:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.203166:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947334.203307:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985664 00000100:00100000:0.0:1783947334.203315:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985664 00000100:00100000:0.0:1783947334.203354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783947334.203363:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985664:12345-0@lo:502: 00000100:00100000:0.0:1783947334.203581:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235985664:12345-0@lo:502: Request processed in 218us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947334.203597:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783947334.204095:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235985664:0@lo:502: 00000040:00080000:3.0:1783947334.204157:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783947334.204168:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1783947334.208255:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783947334.208280:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e7beeebb380) 00000020:00000080:0.0:1783947334.208309:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1783947334.208886:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bff958800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783947334.208891:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bff958800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783947334.208894:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bff958800 3 00010000:00080000:2.0:1783947334.208941:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7be78be800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947334.212251:0:8448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1783947334.212371:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783947334.212438:0:8448:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947334.212453:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe6fd1fdb554fff01 00000100:00080000:3.0:1783947334.212495:0:8448:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947334.212502:0:8448:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e7be78be800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947334.212544:0:8448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bc55b9f80 x1870604235985792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947334.212572:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783947334.212864:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604235985792:0@lo:38: 00000100:00100000:2.0:1783947334.212963:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947334.213391:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235986048:0@lo:400: 00000100:00100000:0.0:1783947334.213446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947334.213497:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947334.213504:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235985920:0@lo:400: 00000100:00100000:0.0:1783947334.213542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947334.213568:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235986176:0@lo:400: 00000100:00100000:0.0:1783947334.213591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947334.213607:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947334.213612:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235986304:0@lo:400: 00000100:00100000:0.0:1783947334.213774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.214286:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985792 00000100:00100000:3.0:1783947334.214296:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985792 00000100:00100000:3.0:1783947334.214340:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235985920 00000100:00100000:3.0:1783947334.214344:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235985920 00000100:00100000:3.0:1783947334.214376:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986176 00000100:00100000:3.0:1783947334.214379:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986176 00000100:00100000:3.0:1783947334.214396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947334.214406:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235985920:12345-0@lo:400: 00000100:00100000:1.0:1783947334.214489:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947334.214502:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235986176:12345-0@lo:400: 00000100:00100000:1.0:1783947334.214590:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235986176:12345-0@lo:400: Request processed in 91us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.214599:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947334.214620:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947334.214625:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604235985792:12345-0@lo:38: 00010000:00080000:1.0:1783947334.214650:0:6510:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:1.0:1783947334.214689:0:6510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe6fd1fdb554fff08 00000004:00100000:1.0:1783947334.214705:0:6510:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783947334.214742:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5889000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947334.214798:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870604235985792:12345-0@lo:38: Request processed in 172us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.214806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783947334.214852:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7beeee8a80 x1870604235986176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947334.214871:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235986176:0@lo:400: 00000100:00100000:3.0:1783947334.215105:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235985920:12345-0@lo:400: Request processed in 701us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.215113:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947334.215133:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986048 00000100:00100000:3.0:1783947334.215137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986048 00000100:00100000:3.0:1783947334.215156:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986304 00000100:00100000:3.0:1783947334.215158:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986304 00000100:00100000:3.0:1783947334.215170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947334.215177:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235986048:12345-0@lo:400: 00010000:00080000:2.0:1783947334.215310:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bc55b9f80 x1870604235985792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947334.215321:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947334.215328:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783947334.215335:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783947334.215340:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783947334.215342:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be78be800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947334.215347:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604235985792:0@lo:38: 00010000:00080000:1.0:1783947334.215433:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7beeee8e00 x1870604235985920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947334.215444:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235985920:0@lo:400: 00000100:00100000:3.0:1783947334.216148:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235986048:12345-0@lo:400: Request processed in 970us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.216157:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947334.216176:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947334.216280:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235986048:0@lo:400: 00000100:00100000:3.0:1783947334.216731:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235986304:12345-0@lo:400: 00000100:00100000:3.0:1783947334.216788:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235986304:12345-0@lo:400: Request processed in 605us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947334.216795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947334.216873:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235986304:0@lo:400: 00000020:01000004:3.0:1783947334.216926:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783947334.216957:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e7bf7f74d40) 00000020:00000080:3.0:1783947334.216981:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1783947334.217891:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bff958800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947334.217897:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bff958800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783947334.217900:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bff958800 3 00010000:00080000:3.0:1783947334.217945:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bffa6f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947334.224999:0:8448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1783947334.225339:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783947334.225416:0:8448:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947334.225432:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe6fd1fdb554fff16 00000100:00080000:3.0:1783947334.225446:0:8448:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947334.225453:0:8448:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e7bffa6f800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947334.225591:0:8448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bc55bbb80 x1870604235986432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947334.225617:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783947334.225902:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604235986432:0@lo:38: 00000040:00080000:0.0:1783947334.226696:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1783947334.226877:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1783947334.227027:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783947334.227058:0:8420:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947334.227084:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947334.227104:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986432 00000100:00100000:0.0:1783947334.227113:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986432 00000100:00100000:0.0:1783947334.227153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947334.227161:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604235986432:12345-0@lo:38: 00010000:00080000:0.0:1783947334.227264:0:6510:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1783947334.227301:0:6510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe6fd1fdb554fff1d 00000004:00100000:0.0:1783947334.227317:0:6510:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783947334.227355:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9e7be7865000 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1783947334.227410:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947334.227487:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870604235986432:12345-0@lo:38: Request processed in 326us (611us total) trans 0 rc 0/0 00000020:01000004:3.0:1783947334.227489:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783947334.227492:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783947334.227494:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:0.0:1783947334.227495:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1783947334.227496:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947334.227497:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947334.227498:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947334.227500:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947334.227502:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947334.227504:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947334.227506:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947334.227507:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947334.227512:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1783947334.227514:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783947334.227515:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783947334.227517:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947334.227518:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947334.227519:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947334.227527:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947334.227529:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947334.227530:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947334.227531:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947334.227531:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947334.227532:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783947334.227556:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783947334.227573:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235986560:0@lo:253: 00000100:00100000:3.0:1783947334.227633:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947334.227665:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947334.227711:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986560 00000100:00100000:0.0:1783947334.227715:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986560 00000100:00100000:0.0:1783947334.227752:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783947334.227761:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235986560:12345-0@lo:253: 20000000:01000000:0.0:1783947334.227784:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783947334.227803:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1783947334.227969:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7bc55bbb80 x1870604235986432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947334.227982:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947334.228052:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783947334.228063:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783947334.228069:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783947334.228072:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bffa6f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947334.228080:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604235986432:0@lo:38: 20000000:01000000:1.0:1783947334.236414:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783947334.236754:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783947334.237115:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:8420:x1870604235986560:12345-0@lo:253: Request processed in 9351us (9476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.237127:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 20000000:01000000:3.0:1783947334.237280:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783947334.237285:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783947334.237309:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.237325:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb554ffe1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.237333:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554ffe36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.237341:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.237386:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554ffe36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.237403:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554ffe36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 15 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947334.237591:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235986688:0@lo:104: 00000100:00100000:3.0:1783947334.237873:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947334.237985:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb554ffe1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947334.238019:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb554ffe1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 15 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947334.238030:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235986816:0@lo:104: 00000100:00100000:3.0:1783947334.238056:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947334.238225:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783947334.238247:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947334.238267:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986688 00000100:00100000:1.0:1783947334.238273:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986688 00000100:00100000:1.0:1783947334.238305:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986816 00000100:00100000:1.0:1783947334.238308:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986816 00000100:00100000:1.0:1783947334.238320:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947334.238328:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bff84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6526:x1870604235986688:12345-0@lo:104: 00010000:00010000:1.0:1783947334.238343:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238393:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947334.238400:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bff84dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6526:x1870604235986688:12345-0@lo:104: Request processed in 73us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.238407:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947334.238536:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947334.238543:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604235986816:12345-0@lo:104: 00010000:00010000:1.0:1783947334.238552:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238584:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947334.238590:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604235986816:12345-0@lo:104: Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.238602:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1783947334.238623:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947334.238700:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238709:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c02052200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947334.238713:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238722:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947334.238729:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947334.238734:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947334.238768:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238776:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947334.238794:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238802:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb554ffe2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238813:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947334.238816:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238834:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c3e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947334.238837:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238845:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947334.238851:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947334.238857:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1783947334.238875:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235986944:0@lo:103: 00010000:00010000:1.0:1783947334.238880:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238887:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947334.238893:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238899:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb554ffe13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe1a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.238916:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947334.238920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947334.238920:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947334.238923:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947334.238948:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235987072:0@lo:103: 00000100:00100000:1.0:1783947334.238979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947334.238980:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235986944 00000100:00100000:2.0:1783947334.238986:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235986944 00010000:00010000:2.0:1783947334.239009:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554ffe36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 16 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.239082:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987072 00000100:00100000:2.0:1783947334.239085:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987072 00010000:00010000:2.0:1783947334.239098:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb554ffe1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 17 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.239118:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947334.239125:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3639:x1870604235986944:12345-0@lo:103: 00010000:00010000:2.0:1783947334.239137:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947334.239142:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554ffe36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 17 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.239152:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554ffe36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 17 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.239171:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947334.239541:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947334.239551:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3640:x1870604235987072:12345-0@lo:103: 00010000:00010000:1.0:1783947334.239568:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947334.239574:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb554ffe1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 17 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239584:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb554ffe1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 17 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239600:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239608:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783947334.239624:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002911906s 00000100:00100000:2.0:1783947334.239676:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3639:x1870604235986944:12345-0@lo:103: Request processed in 550us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.239684:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1783947334.239707:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239717:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239726:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239733:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.239735:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235986944:0@lo:103: 00010000:00010000:1.0:1783947334.239747:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947334.239753:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239761:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239779:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947334.239788:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947334.239822:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:3640:x1870604235987072:12345-0@lo:103: Request processed in 272us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947334.239830:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947334.239858:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604235987072:0@lo:103: 00010000:00010000:3.0:1783947334.240220:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947334.240247:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8420:1870604235986560:0@lo:253: 10000000:01000000:3.0:1783947334.240260:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783947334.240263:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783947334.240265:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783947334.240267:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947334.240268:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947334.240269:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947334.240270:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947334.240272:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783947334.240274:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783947334.240275:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783947334.240278:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947334.240279:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783947334.240294:0:8420:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783947334.241596:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554ffe36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe2f expref: 15 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.241638:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235986688:0@lo:104: 00010000:00010000:2.0:1783947334.241655:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb554ffe1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe13 expref: 14 pid: 6503 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947334.241665:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604235986816:0@lo:104: 00010000:00010000:2.0:1783947334.241684:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.241695:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.241701:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947334.241707:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96800/0xe6fd1fdb554fff24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1783947334.249821:0:8420:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783947334.249993:0:8420:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783947334.250191:0:8420:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783947334.250768:0:8420:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783947334.251006:0:8420:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783947334.251326:0:8420:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1783947334.253068:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783947334.265026:0:8420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783947334.265036:0:8420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783947334.265080:0:8420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783947334.265130:0:8420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783947334.265155:0:8420:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783947334.265176:0:8420:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1783947334.266297:0:8420:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947334.266538:0:8420:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1783947334.388806:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235987200:0@lo:41: 00000100:00100000:2.0:1783947334.388926:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947334.392558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987200 00000100:00100000:2.0:1783947334.392579:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987200 00000100:00100000:2.0:1783947334.392668:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947334.392683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235987200:12345-0@lo:41: 00000004:00000024:2.0:1783947334.392739:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1783947334.392861:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235987200:12345-0@lo:41: Request processed in 182us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947334.392871:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947334.392945:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235987200:0@lo:41: 00010000:00010000:3.0:1783947334.836693:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783947335.187717:0:8504:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947335.187969:0:8504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1783947335.539684:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783947335.539692:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7be784d800 from 30 10000000:01000000:2.0:1783947335.539698:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947335.539749:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.539761:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.539774:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947335.539800:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987328:0@lo:101: 00000100:00100000:2.0:1783947335.539868:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.539986:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.547734:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987328 00000100:00100000:0.0:1783947335.547750:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987328 00000100:00100000:0.0:1783947335.547821:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783947335.547832:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:6507:x1870604235987328:12345-0@lo:101: 00010000:00010000:0.0:1783947335.547853:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947335.547875:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fff2b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.547905:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.547928:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.547938:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a800, rc 0) 00000100:00100000:0.0:1783947335.548020:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235987328:12345-0@lo:101: Request processed in 191us (8151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947335.548043:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783947335.550005:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987328:0@lo:101: 00010000:00010000:2.0:1783947335.550040:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.550054:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947335.550155:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987456:0@lo:501: 00000100:00100000:2.0:1783947335.550227:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.550270:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.550554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987456 00000100:00100000:1.0:1783947335.550563:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987456 00000100:00100000:1.0:1783947335.550601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947335.550610:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235987456:12345-0@lo:501: 00000100:00100000:1.0:1783947335.550792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235987456:12345-0@lo:501: Request processed in 182us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.550800:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783947335.551868:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987456:0@lo:501: 00000100:00100000:2.0:1783947335.552083:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987584:0@lo:503: 00000100:00100000:2.0:1783947335.552153:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.552314:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.553924:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987584 00000100:00100000:3.0:1783947335.553949:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987584 00000100:00100000:3.0:1783947335.554307:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783947335.554318:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235987584:12345-0@lo:503: 00000100:00100000:3.0:1783947335.555242:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235987584:12345-0@lo:503: Request processed in 921us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.555253:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783947335.555282:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987584:0@lo:503: 00000100:00100000:0.0:1783947335.558035:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8523:1870604235987712:0@lo:502: 00000100:00100000:0.0:1783947335.558128:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.558175:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0188a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947335.559424:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987712 00000100:00100000:2.0:1783947335.559434:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987712 00000100:00100000:2.0:1783947335.559515:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947335.559526:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8523:x1870604235987712:12345-0@lo:502: 00000100:00100000:2.0:1783947335.559703:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8523:x1870604235987712:12345-0@lo:502: Request processed in 178us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.559712:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783947335.560926:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8523:1870604235987712:0@lo:502: 00000100:00100000:0.0:1783947335.561018:0:8523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8523:1870604235987840:0@lo:502: 00000100:00100000:0.0:1783947335.561218:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.561254:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987840 00000100:00100000:0.0:1783947335.561260:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987840 00000100:00100000:0.0:1783947335.561302:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783947335.561312:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8523:x1870604235987840:12345-0@lo:502: 00000100:00100000:0.0:1783947335.561412:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:8523:x1870604235987840:12345-0@lo:502: Request processed in 101us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947335.561419:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783947335.565121:0:8523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc62b4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.565169:0:8523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8523:1870604235987840:0@lo:502: 00000040:00080000:0.0:1783947335.565220:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783947335.565297:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783947335.565320:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947335.565332:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.565344:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947335.565354:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783947335.565367:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be784d800 from 5 10000000:01000000:0.0:1783947335.565370:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783947335.565411:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.565419:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.565429:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947335.565448:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987968:0@lo:101: 00000100:00100000:0.0:1783947335.567197:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.567427:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc62b4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947335.574627:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235987968 00000100:00100000:2.0:1783947335.574643:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235987968 00000100:00100000:2.0:1783947335.574718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783947335.574730:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604235987968:12345-0@lo:101: 00010000:00010000:2.0:1783947335.574753:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947335.574775:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fff39 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.574805:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.574818:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.574828:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ec00, rc 0) 00000100:00100000:2.0:1783947335.574930:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235987968:12345-0@lo:101: Request processed in 201us (7738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.574937:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783947335.575011:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235987968:0@lo:101: 00010000:00010000:2.0:1783947335.575177:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.575188:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947335.575263:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988096:0@lo:256: 00000100:00100000:2.0:1783947335.575303:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.575378:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.580644:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988096 00000100:00100000:0.0:1783947335.580659:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988096 00000100:00100000:1.0:1783947335.580824:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783947335.580836:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235988096:12345-0@lo:256: 20000000:01000000:1.0:1783947335.580867:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947335.580889:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947335.580892:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783947335.581052:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235988096:12345-0@lo:256: Request processed in 218us (5748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.581060:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783947335.581129:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988096:0@lo:256: 10000000:01000000:2.0:1783947335.581194:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947335.581206:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.581218:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947335.581229:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1783947335.581232:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1783947335.581235:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783947335.581270:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.581279:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947335.581290:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947335.581323:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988224:0@lo:101: 00000100:00100000:2.0:1783947335.581360:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.581403:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8c540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.581578:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988224 00000100:00100000:1.0:1783947335.581584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988224 00000100:00100000:1.0:1783947335.581628:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783947335.581636:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604235988224:12345-0@lo:101: 00010000:00010000:1.0:1783947335.581648:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947335.581661:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fff47 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.581682:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.581694:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.581704:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c021c3a00, rc 0) 00000100:00100000:1.0:1783947335.581740:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235988224:12345-0@lo:101: Request processed in 104us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.581746:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783947335.581920:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988224:0@lo:101: 00010000:00010000:0.0:1783947335.581935:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.581946:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947335.582005:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988352:0@lo:501: 00000100:00100000:0.0:1783947335.582130:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.582161:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc62b4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.583795:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988352 00000100:00100000:1.0:1783947335.583806:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988352 00000100:00100000:1.0:1783947335.583863:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783947335.583873:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235988352:12345-0@lo:501: 00000100:00100000:1.0:1783947335.585393:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235988352:12345-0@lo:501: Request processed in 1031us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.585408:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783947335.593736:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988352:0@lo:501: 00000100:00100000:1.0:1783947335.593820:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988480:0@lo:503: 00000100:00100000:1.0:1783947335.593991:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.594044:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.595799:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988480 00000100:00100000:3.0:1783947335.595813:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988480 00000100:00100000:3.0:1783947335.595896:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783947335.595921:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235988480:12345-0@lo:503: 00000100:00100000:3.0:1783947335.596764:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235988480:12345-0@lo:503: Request processed in 855us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.596775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783947335.597793:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235988480:0@lo:503: 00000100:00100000:0.0:1783947335.598767:0:8526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8526:1870604235988608:0@lo:502: 00000100:00100000:0.0:1783947335.598845:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.598882:0:8526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc62b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.599006:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988608 00000100:00100000:1.0:1783947335.599014:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988608 00000100:00100000:1.0:1783947335.599080:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783947335.599093:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8526:x1870604235988608:12345-0@lo:502: 00000100:00100000:1.0:1783947335.599228:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8526:x1870604235988608:12345-0@lo:502: Request processed in 138us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.599235:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783947335.602602:0:8526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8526:1870604235988608:0@lo:502: 00000020:01000000:0.0:1783947335.602653:0:8526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947335.602664:0:8526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783947335.602672:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947335.602676:0:8526:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783947335.602682:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783947335.602686:0:8526:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:0.0:1783947335.602714:0:8526:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783947335.602717:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947335.602745:0:8526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e7c01b899c0) 00000020:00000080:0.0:1783947335.602774:0:8526:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1783947335.602781:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783947335.602900:0:8526:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783947335.603368:0:8526:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783947335.603388:0:8526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb554fff5c 00010000:00080000:0.0:1783947335.603425:0:8526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7c01b95800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1783947335.603759:0:8526:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1783947335.629097:0:8526:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1783947335.629125:0:8526:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1783947335.629356:0:8526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947335.629750:0:8526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947335.629841:0:8526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1783947335.629973:0:8526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783947335.633538:0:8529:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947335.633548:0:8529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783947335.637013:0:8526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947335.637033:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783947335.637086:0:8526:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783947335.637116:0:8526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb554fff63 00000100:00080000:3.0:1783947335.637129:0:8526:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947335.637136:0:8526:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e7c01b95800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947335.637191:0:8526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bc55bb480 x1870604235988736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947335.637219:0:8526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783947335.637282:0:8526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947335.637286:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947335.637288:0:8526:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783947335.637291:0:8526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947335.637295:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947335.637296:0:8526:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783947335.637306:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783947335.637308:0:8526:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783947335.637353:0:8526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8526:1870604235988864:0@lo:502: 00000100:00100000:1.0:1783947335.637597:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604235988992:0@lo:400: 00000100:00100000:0.0:1783947335.637707:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604235988736:0@lo:8: 00000100:00100000:1.0:1783947335.643056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.643920:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.644221:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235989120:0@lo:400: 00000100:00100000:3.0:1783947335.644222:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.644254:0:8526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947335.644283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.644287:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988736 00000100:00100000:3.0:1783947335.644297:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988736 00000100:00100000:2.0:1783947335.644311:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604235989632:0@lo:400: 00000100:00100000:2.0:1783947335.644338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.644360:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947335.644367:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604235989248:0@lo:400: 00000100:00100000:2.0:1783947335.644389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.644476:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947335.644484:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604235988736:12345-0@lo:8: 00000100:00100000:1.0:1783947335.644497:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604235989504:0@lo:400: 00010000:00080000:3.0:1783947335.644521:0:8426:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000100:00100000:1.0:1783947335.644534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1783947335.644560:0:8426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb554fff6a 00000100:00100000:1.0:1783947335.644561:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947335.644570:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235989376:0@lo:400: 00000100:00100000:1.0:1783947335.644597:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1783947335.644607:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e7ac5830000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1783947335.644613:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1783947335.644618:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1783947335.644637:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988992 00000100:00100000:1.0:1783947335.644642:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988992 00000100:00100000:1.0:1783947335.644674:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235989632 00000100:00100000:1.0:1783947335.644678:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235989632 00002000:00100000:3.0:1783947335.644693:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783947335.644703:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235989248 00000100:00100000:1.0:1783947335.644708:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235989248 00000100:00100000:1.0:1783947335.644723:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235989504 00000100:00100000:1.0:1783947335.644726:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235989504 00000100:00100000:1.0:1783947335.644746:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947335.644755:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604235988992:12345-0@lo:400: 00000100:00100000:1.0:1783947335.644817:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604235988992:12345-0@lo:400: Request processed in 63us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.644825:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947335.644849:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947335.644867:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604235989632:12345-0@lo:400: 00000100:00100000:1.0:1783947335.644931:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604235989632:12345-0@lo:400: Request processed in 66us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.644938:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947335.644957:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783947335.644965:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604235989248:12345-0@lo:400: 00002000:00080000:3.0:1783947335.645005:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1783947335.645006:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604235989248:12345-0@lo:400: Request processed in 42us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.645015:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783947335.645028:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947335.645035:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604235989504:12345-0@lo:400: 00000100:00100000:1.0:1783947335.645063:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604235989504:12345-0@lo:400: Request processed in 29us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.645069:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783947335.645091:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947335.645095:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947335.645111:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5830800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1783947335.645128:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4746d80 x1870604235988992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947335.645146:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604235988992:0@lo:400: 00010000:00080000:1.0:1783947335.645160:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4746680 x1870604235989504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947335.645169:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604235989504:0@lo:400: 00000100:00100000:3.0:1783947335.645282:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604235988736:12345-0@lo:8: Request processed in 797us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.645289:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947335.645595:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235988864 00000100:00100000:3.0:1783947335.645601:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235988864 00000100:00100000:3.0:1783947335.645634:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783947335.645641:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8526:x1870604235988864:12345-0@lo:502: 00000100:00100000:3.0:1783947335.645789:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:8526:x1870604235988864:12345-0@lo:502: Request processed in 147us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.645795:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783947335.645922:0:8526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8526:1870604235988864:0@lo:502: 00000020:01000000:0.0:1783947335.645960:0:8526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947335.645974:0:8526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947335.645977:0:8526:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783947335.645983:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1783947335.646206:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1783947335.646228:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783947335.646240:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.646322:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947335.646333:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783947335.646336:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc9511800 from 30 10000000:01000000:3.0:1783947335.646339:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783947335.646376:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.646384:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.646393:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947335.646413:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235989760:0@lo:101: 00000100:00100000:3.0:1783947335.646452:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.646518:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee2600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.646686:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235989760 00000100:00100000:0.0:1783947335.646693:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235989760 00000100:00100000:0.0:1783947335.646730:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783947335.646804:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235989120 00000100:00100000:2.0:1783947335.646810:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235989120 00000100:00100000:0.0:1783947335.646817:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604235989760:12345-0@lo:101: 00010000:00010000:0.0:1783947335.646833:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783947335.646836:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235989376 00000100:00100000:2.0:1783947335.646841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235989376 00010000:00010000:0.0:1783947335.646849:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fff71 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947335.646861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947335.646870:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235989120:12345-0@lo:400: 00010000:00010000:0.0:1783947335.646872:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.646884:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.646890:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a200, rc 0) 00000100:00100000:3.0:1783947335.646974:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235989760:0@lo:101: 00010000:00080000:1.0:1783947335.646981:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc55bb480 x1870604235988736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783947335.646989:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947335.646993:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00010000:00010000:3.0:1783947335.647000:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947335.647177:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235989888:0@lo:501: 00000100:00080000:1.0:1783947335.647230:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783947335.647240:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783947335.647246:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783947335.647250:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c01b95800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783947335.647265:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783947335.647272:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604235988736:0@lo:8: 00000100:00100000:0.0:1783947335.647899:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235989760:12345-0@lo:101: Request processed in 1155us (1438us total) trans 0 rc 0/0 00000004:00080000:1.0:1783947335.647903:0:8529:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783947335.647922:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000004:00080000:1.0:1783947335.647993:0:8529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 220875535424ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783947335.648000:0:8529:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783947335.648192:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.648269:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee2600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947335.651340:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235989120:12345-0@lo:400: Request processed in 4459us (7044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.651357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947335.651399:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947335.651412:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235989376:12345-0@lo:400: 00000100:00100000:1.0:1783947335.651574:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235989888 00000100:00100000:1.0:1783947335.651584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235989888 00000100:00100000:1.0:1783947335.651628:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783947335.651635:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235989888:12345-0@lo:501: 00000100:00100000:2.0:1783947335.651815:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235989376:12345-0@lo:400: Request processed in 403us (7212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.651822:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783947335.651961:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235989888:12345-0@lo:501: Request processed in 326us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.651969:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1783947335.651982:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4744000 x1870604235989248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947335.652007:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604235989248:0@lo:400: 00000100:00100000:1.0:1783947335.652024:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235989376:0@lo:400: 00000100:00100000:2.0:1783947335.652260:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235989120:0@lo:400: 00010000:00080000:2.0:1783947335.652276:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4744a80 x1870604235989632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947335.652285:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604235989632:0@lo:400: 00000100:00100000:3.0:1783947335.664108:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235989888:0@lo:501: 00000100:00100000:3.0:1783947335.664191:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990016:0@lo:503: 00000100:00100000:3.0:1783947335.664283:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.664352:0:8530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235990144:0@lo:700: 00000100:00100000:2.0:1783947335.664392:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783947335.666246:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1783947335.668713:0:8530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.676030:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee2600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.676093:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990144 00000100:00100000:3.0:1783947335.676103:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990144 00000100:00100000:3.0:1783947335.676195:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947335.676205:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8530:x1870604235990144:12345-0@lo:700: 00000100:00100000:3.0:1783947335.676277:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1870604235990272:0@lo:700: 00000100:00100000:3.0:1783947335.676339:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.676362:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.676414:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990272 00000100:00100000:3.0:1783947335.676418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990272 00000100:00100000:3.0:1783947335.676453:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947335.676488:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1870604235990272:12345-0@lo:700: 00000100:00100000:3.0:1783947335.676617:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990016 00000100:00100000:3.0:1783947335.676622:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990016 00000100:00100000:3.0:1783947335.676654:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783947335.676661:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235990016:12345-0@lo:503: 00000100:00100000:3.0:1783947335.676790:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235990016:12345-0@lo:503: Request processed in 129us (12509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.676808:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783947335.676873:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990016:0@lo:503: 00000100:00080000:0.0:1783947335.680547:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947335.681085:0:8532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8532:1870604235990400:0@lo:502: 00000100:00100000:0.0:1783947335.681177:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.681228:0:8532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.681527:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990400 00000100:00100000:0.0:1783947335.681536:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990400 00000100:00100000:3.0:1783947335.681598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783947335.681611:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8532:x1870604235990400:12345-0@lo:502: 00000100:00100000:3.0:1783947335.681758:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8532:x1870604235990400:12345-0@lo:502: Request processed in 149us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.681766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947335.681976:0:8532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8532:1870604235990400:0@lo:502: 00000100:00100000:0.0:1783947335.682037:0:8532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8532:1870604235990528:0@lo:502: 00000100:00100000:0.0:1783947335.682085:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.682113:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990528 00000100:00100000:0.0:1783947335.682117:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990528 00000100:00100000:0.0:1783947335.682144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783947335.682153:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8532:x1870604235990528:12345-0@lo:502: 00000100:00100000:0.0:1783947335.682234:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:8532:x1870604235990528:12345-0@lo:502: Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947335.682242:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783947335.682278:0:8532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.682293:0:8532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8532:1870604235990528:0@lo:502: 00000040:00080000:0.0:1783947335.682314:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1783947335.682412:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1783947335.682439:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947335.682453:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.682487:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947335.682497:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947335.682500:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bc9511800 from 5 10000000:01000000:3.0:1783947335.682503:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947335.682530:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.682539:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.682549:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947335.682561:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990656:0@lo:101: 00000100:00100000:3.0:1783947335.682593:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.682616:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.682672:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990656 00000100:00100000:0.0:1783947335.682678:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990656 00000100:00100000:0.0:1783947335.683296:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783947335.683305:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604235990656:12345-0@lo:101: 00010000:00010000:0.0:1783947335.683320:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947335.683336:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fff7f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.683372:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.683388:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.683398:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:0.0:1783947335.683443:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604235990656:12345-0@lo:101: Request processed in 140us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947335.683475:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783947335.683781:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990656:0@lo:101: 00010000:00010000:3.0:1783947335.683799:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.683809:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947335.683877:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990784:0@lo:256: 00000100:00100000:3.0:1783947335.683936:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.683968:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.683986:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990784 00000100:00100000:3.0:1783947335.683992:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990784 00000100:00100000:3.0:1783947335.684045:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783947335.684054:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604235990784:12345-0@lo:256: 20000000:01000000:3.0:1783947335.684072:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783947335.684089:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783947335.684093:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783947335.684202:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604235990784:12345-0@lo:256: Request processed in 149us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.684211:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783947335.684232:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990784:0@lo:256: 10000000:01000000:0.0:1783947335.684279:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783947335.684286:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.684295:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947335.684303:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783947335.684305:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1783947335.684308:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783947335.684331:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.684338:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.684347:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947335.684406:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990912:0@lo:101: 00000100:00100000:0.0:1783947335.684434:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.684448:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.684478:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235990912 00000100:00100000:0.0:1783947335.684482:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235990912 00000100:00100000:0.0:1783947335.684529:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783947335.684537:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604235990912:12345-0@lo:101: 00010000:00010000:0.0:1783947335.684554:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947335.684565:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fff8d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.684582:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.684593:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947335.684602:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b400, rc 0) 00000100:00100000:0.0:1783947335.684774:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604235990912:12345-0@lo:101: Request processed in 168us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947335.684782:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783947335.685014:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235990912:0@lo:101: 00010000:00010000:3.0:1783947335.685026:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.685035:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947335.685099:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991040:0@lo:501: 00000100:00100000:3.0:1783947335.685126:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.685255:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.685288:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991040 00000100:00100000:0.0:1783947335.685293:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991040 00000100:00100000:3.0:1783947335.687478:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783947335.687503:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604235991040:12345-0@lo:501: 40000000:02000000:0.0:1783947335.687925:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1783947335.688222:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604235991040:12345-0@lo:501: Request processed in 730us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.688232:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783947335.688652:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991040:0@lo:501: 00000100:00100000:1.0:1783947335.688717:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991168:0@lo:503: 00000100:00100000:1.0:1783947335.688786:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.688819:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.688838:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991168 00000100:00100000:1.0:1783947335.688846:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991168 00000100:00100000:1.0:1783947335.688894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783947335.688915:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604235991168:12345-0@lo:503: 00000100:00100000:1.0:1783947335.691838:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604235991168:12345-0@lo:503: Request processed in 2926us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.691864:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783947335.691972:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991168:0@lo:503: 00000100:00100000:1.0:1783947335.694577:0:8533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8533:1870604235991296:0@lo:502: 00000100:00100000:1.0:1783947335.694664:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.694703:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991296 00000100:00100000:1.0:1783947335.694710:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991296 00000100:00100000:1.0:1783947335.694759:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783947335.694768:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:8533:x1870604235991296:12345-0@lo:502: 00000100:00100000:1.0:1783947335.694896:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:8533:x1870604235991296:12345-0@lo:502: Request processed in 128us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.694917:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783947335.696492:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1870604235990272:12345-0@lo:700: Request processed in 19999us (20146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947335.696505:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947335.697339:0:8533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.697379:0:8533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8533:1870604235991296:0@lo:502: 00000020:01000000:1.0:1783947335.697435:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783947335.697444:0:8533:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783947335.697452:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947335.697468:0:8533:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783947335.697474:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783947335.697478:0:8533:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:1.0:1783947335.697507:0:8533:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783947335.697510:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947335.697533:0:8533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e7bf3fb0000) 00000020:00000080:1.0:1783947335.697557:0:8533:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783947335.697563:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00010000:00080000:3.0:1783947335.697628:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc55bbb80 x1870604235990272/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947335.697645:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1870604235990272:0@lo:700: 40000000:02000000:3.0:1783947335.697655:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000004:00080000:1.0:1783947335.697686:0:8533:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783947335.697694:0:8533:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783947335.697702:0:8533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb554fffa2 00010000:00080000:1.0:1783947335.697736:0:8533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac5888800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947335.698009:0:8533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:2.0:1783947335.724083:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783947335.724271:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8530:x1870604235990144:12345-0@lo:700: Request processed in 48064us (59874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.724290:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783947335.724351:0:8530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac5841500 x1870604235990144/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947335.724367:0:8530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235990144:0@lo:700: 00000040:01000000:3.0:1783947335.726726:0:8533:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783947335.726752:0:8533:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783947335.727009:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947335.727256:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947335.727348:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783947335.727491:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1783947335.732965:0:8534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947335.732973:0:8534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783947335.739516:0:8533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947335.739534:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783947335.739577:0:8533:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783947335.739604:0:8533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb554fffa9 00000100:00080000:1.0:1783947335.739614:0:8533:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947335.739621:0:8533:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7ac5888800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947335.739661:0:8533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bc4746680 x1870604235991424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947335.739686:0:8533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783947335.739748:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947335.739752:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947335.739754:0:8533:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783947335.739757:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947335.739761:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947335.739763:0:8533:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783947335.739766:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783947335.739768:0:8533:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783947335.739800:0:8533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8533:1870604235991552:0@lo:502: 00000100:00100000:1.0:1783947335.739888:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.739938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991552 00000100:00100000:1.0:1783947335.739945:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991552 00000100:00100000:1.0:1783947335.740230:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783947335.740240:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:8533:x1870604235991552:12345-0@lo:502: 00000100:00100000:1.0:1783947335.740370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:8533:x1870604235991552:12345-0@lo:502: Request processed in 131us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.740378:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783947335.740434:0:8533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.740472:0:8533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:8533:1870604235991552:0@lo:502: 00000020:01000000:1.0:1783947335.740505:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947335.740509:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947335.740512:0:8533:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783947335.740516:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1783947335.740563:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1783947335.740584:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783947335.740597:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.740609:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947335.740620:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783947335.740622:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e7bc5510000 from 1 10000000:01000000:1.0:1783947335.740625:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947335.740651:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.740659:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.740670:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947335.740682:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991680:0@lo:101: 00000100:00100000:1.0:1783947335.740708:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.740721:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.740733:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991680 00000100:00100000:1.0:1783947335.740737:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991680 00000100:00100000:1.0:1783947335.740758:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783947335.740769:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604235991680:12345-0@lo:101: 00010000:00010000:1.0:1783947335.740778:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947335.740791:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fffb0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.740814:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.740825:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.740835:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c021c3200, rc 0) 00000100:00100000:1.0:1783947335.740866:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604235991680:12345-0@lo:101: Request processed in 98us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.740872:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783947335.740901:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991680:0@lo:101: 00010000:00010000:1.0:1783947335.740926:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947335.740936:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947335.740987:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604235991424:0@lo:8: 00000100:00100000:3.0:1783947335.741034:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.741073:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991424 00000100:00100000:3.0:1783947335.741077:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991424 00000100:00100000:3.0:1783947335.741103:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947335.741109:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604235991424:12345-0@lo:8: 00010000:00080000:3.0:1783947335.741136:0:8429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1783947335.741176:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb554fffbe 00002000:00100000:3.0:1783947335.741191:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e7bffa6c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783947335.741195:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783947335.741197:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783947335.741289:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783947335.741315:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e7bffa6d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947335.741358:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604235991424:12345-0@lo:8: Request processed in 248us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947335.741365:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783947335.741396:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4746680 x1870604235991424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947335.741407:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947335.741414:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783947335.741423:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783947335.741429:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783947335.741431:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5888800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783947335.741442:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783947335.741446:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604235991424:0@lo:8: 00000004:00080000:3.0:1783947335.741494:0:8534:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783947335.741552:0:8534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 220969094273ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783947335.741558:0:8534:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783947335.742131:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991808:0@lo:501: 00000100:00100000:1.0:1783947335.742248:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.742277:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.742797:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991808 00000100:00100000:3.0:1783947335.742805:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991808 00000100:00100000:3.0:1783947335.742866:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783947335.742875:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604235991808:12345-0@lo:501: 00000100:00100000:3.0:1783947335.742997:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604235991808:12345-0@lo:501: Request processed in 124us (824us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947335.743015:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783947335.743068:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604235991808:0@lo:501: 10000000:01000000:3.0:1783947335.743110:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783947335.743121:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947335.743133:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947335.745324:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1783947335.745475:0:8530:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783947335.745507:0:8530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235992064:0@lo:7: 00000100:00100000:1.0:1783947335.745510:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235991936:0@lo:13: 00000100:00100000:2.0:1783947335.745593:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.745593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947335.745637:0:8530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947335.745672:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992064 00000100:00100000:1.0:1783947335.745677:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235991936 00000100:00100000:2.0:1783947335.745687:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992064 00000100:00100000:1.0:1783947335.745687:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235991936 00000100:00100000:2.0:1783947335.745743:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947335.745750:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947335.745755:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8530:x1870604235992064:12345-0@lo:7: 00000100:00100000:1.0:1783947335.745763:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870604235991936:12345-0@lo:13: 00002000:00000024:1.0:1783947335.745785:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:1.0:1783947335.745838:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870604235991936:12345-0@lo:13: Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.745844:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783947335.745882:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac5841500 x1870604235991936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947335.745914:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235991936:0@lo:13: 00002000:00080000:2.0:1783947335.758083:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1783947335.758092:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783947335.758206:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8530:x1870604235992064:12345-0@lo:7: Request processed in 12450us (12615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.758219:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783947335.759173:0:8530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac5840e00 x1870604235992064/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947335.759195:0:8530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235992064:0@lo:7: 00000004:00080000:3.0:1783947335.759215:0:8530:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783947335.759270:0:8530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235992192:0@lo:5: 00000100:00100000:3.0:1783947335.759316:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947335.759340:0:8530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63faa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.759366:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992192 00000100:00100000:3.0:1783947335.759373:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992192 00000100:00100000:3.0:1783947335.759425:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947335.761513:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8530:x1870604235992192:12345-0@lo:5: 00002000:00080000:3.0:1783947335.761567:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1783947335.761669:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8530:x1870604235992192:12345-0@lo:5: Request processed in 2235us (2351us total) trans 0 rc 0/0 00010000:00080000:1.0:1783947335.761816:0:8530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc55bb480 x1870604235992192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947335.761840:0:8530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235992192:0@lo:5: 00000004:00080000:1.0:1783947335.761857:0:8530:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783947335.761934:0:8530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235992320:0@lo:5: 00000100:00100000:1.0:1783947335.762479:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.762523:0:8530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.762563:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783947335.762574:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1783947335.765612:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992320 00000100:00100000:1.0:1783947335.765626:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992320 00000004:00080000:0.0:1783947335.767133:0:8535:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783947335.767172:0:8535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235992576:0@lo:7: 00000100:00100000:0.0:1783947335.767256:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.767286:0:8535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.767307:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235992448:0@lo:13: 00000100:00100000:0.0:1783947335.767348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.767418:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992448 00000100:00100000:0.0:1783947335.767426:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992448 00000100:00100000:0.0:1783947335.767496:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947335.767506:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235992448:12345-0@lo:13: 00002000:00000024:0.0:1783947335.767533:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1783947335.767579:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235992448:12345-0@lo:13: Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947335.767585:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783947335.767607:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947335.767641:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7beeee8a80 x1870604235992448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947335.767662:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235992448:0@lo:13: 00000100:00100000:0.0:1783947335.767685:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992576 00000100:00100000:0.0:1783947335.767688:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992576 00000100:00100000:3.0:1783947335.768505:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947335.768535:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947335.768547:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8530:x1870604235992320:12345-0@lo:5: 00002000:00080000:3.0:1783947335.768598:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1783947335.769518:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947335.769537:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8535:x1870604235992576:12345-0@lo:7: 00000100:00100000:3.0:1783947335.773208:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8530:x1870604235992320:12345-0@lo:5: Request processed in 4657us (11224us total) trans 4294967297 rc 0/0 00010000:00080000:1.0:1783947335.773299:0:8530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4746680 x1870604235992320/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947335.773320:0:8530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8530:1870604235992320:0@lo:5: 00000004:00080000:1.0:1783947335.773338:0:8530:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1783947335.773385:0:8530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8530:1870604235992704:0@lo:900: 00000100:00100000:1.0:1783947335.773437:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.773489:0:8530:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947335.773517:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992704 00000100:00100000:1.0:1783947335.773525:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992704 00000100:00100000:1.0:1783947335.773571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947335.773579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8530:x1870604235992704:12345-0@lo:900: 00000100:00100000:1.0:1783947335.773627:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8530:x1870604235992704:12345-0@lo:900: Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947335.773634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783947335.773677:0:8530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4744a80 x1870604235992704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947335.773688:0:8530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8530:1870604235992704:0@lo:900: 00002000:00080000:2.0:1783947335.781995:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783947335.782005:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783947335.782123:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8535:x1870604235992576:12345-0@lo:7: Request processed in 12585us (14862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.782136:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783947335.782165:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7beeee9f80 x1870604235992576/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947335.782184:0:8535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235992576:0@lo:7: 00000004:00080000:0.0:1783947335.782203:0:8535:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783947335.782252:0:8535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235992832:0@lo:5: 00000100:00100000:0.0:1783947335.782287:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.782315:0:8535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.782334:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992832 00000100:00100000:0.0:1783947335.782342:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992832 00000100:00100000:0.0:1783947335.782383:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947335.782403:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8535:x1870604235992832:12345-0@lo:5: 00002000:00080000:0.0:1783947335.782437:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783947335.782441:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1783947335.783981:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:00080000:2.0:1783947335.791561:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1783947335.791580:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1783947335.791588:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783947335.793890:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8535:x1870604235992832:12345-0@lo:5: Request processed in 11479us (11593us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783947335.793913:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783947335.794149:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6aa00 x1870604235992832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947335.794164:0:8535:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783947335.794172:0:8535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235992832:0@lo:5: 00000004:00080000:0.0:1783947335.794190:0:8535:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783947335.794247:0:8535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235992960:0@lo:700: 00000100:00100000:0.0:1783947335.794285:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947335.794327:0:8535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947335.794352:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235992960 00000100:00100000:0.0:1783947335.794359:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235992960 00000100:00100000:0.0:1783947335.794567:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947335.794578:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8535:x1870604235992960:12345-0@lo:700: 00000100:00100000:2.0:1783947335.808106:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8535:x1870604235992960:12345-0@lo:700: Request processed in 13520us (13809us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947335.808122:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783947335.808187:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6aa00 x1870604235992960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947335.808209:0:8535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235992960:0@lo:700: 00000004:02000040:0.0:1783947335.819253:0:8535:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1783947335.829955:0:8535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235993088:0@lo:5: 00000100:00100000:1.0:1783947335.830051:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947335.830109:0:8535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947335.830257:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993088 00000100:00100000:3.0:1783947335.830265:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993088 00000100:00100000:3.0:1783947335.830321:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947335.830330:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8535:x1870604235993088:12345-0@lo:5: 00002000:00080000:3.0:1783947335.836262:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783947335.836288:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1783947335.841210:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8535:x1870604235993088:12345-0@lo:5: Request processed in 10873us (11151us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783947335.841224:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783947335.841395:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4744a80 x1870604235993088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947335.841417:0:8535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1870604235993088:0@lo:5: 00000004:00080000:1.0:1783947335.841436:0:8535:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1783947335.859793:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947336.438928:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235993216:0@lo:41: 00000100:00100000:1.0:1783947336.439012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947336.442983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993216 00000100:00100000:2.0:1783947336.443002:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993216 00000100:00100000:2.0:1783947336.443082:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947336.443095:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235993216:12345-0@lo:41: 00000004:00000024:2.0:1783947336.443162:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783947336.443251:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235993216:12345-0@lo:41: Request processed in 160us (4241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947336.443259:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947336.443324:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235993216:0@lo:41: 00010000:00010000:2.0:1783947336.885008:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947337.910602:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947338.931940:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947339.507610:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947339.507639:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235993344:0@lo:41: 00000100:00100000:1.0:1783947339.507712:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947339.508039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993344 00000100:00100000:2.0:1783947339.508049:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993344 00000100:00100000:2.0:1783947339.508115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947339.508126:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235993344:12345-0@lo:41: 00000004:00000024:2.0:1783947339.508167:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1783947339.508233:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235993344:12345-0@lo:41: Request processed in 108us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947339.508240:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947339.508289:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235993344:0@lo:41: 00010000:00010000:3.0:1783947339.956211:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783947340.252642:0:8803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783947340.980562:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947341.043592:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947341.043625:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235993472:0@lo:13: 00000100:00100000:1.0:1783947341.043697:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.043750:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604235993856:0@lo:400: 00000100:00100000:1.0:1783947341.043776:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.043794:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604235994368:0@lo:400: 00000100:00100000:1.0:1783947341.043828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.043846:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783947341.043852:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235993984:0@lo:400: 00000100:00100000:1.0:1783947341.043889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.043910:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604235994496:0@lo:400: 00000100:00100000:1.0:1783947341.043937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.043968:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993856 00000100:00100000:1.0:1783947341.043976:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993856 00000100:00100000:1.0:1783947341.044019:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235994368 00000100:00100000:1.0:1783947341.044023:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235994368 00000100:00100000:1.0:1783947341.044046:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235994496 00000100:00100000:1.0:1783947341.044049:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235994496 00000100:00100000:1.0:1783947341.044065:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947341.044074:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235993600:0@lo:13: 00000100:00100000:1.0:1783947341.044087:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604235993856:12345-0@lo:400: 00000100:00100000:0.0:1783947341.044102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947341.044120:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235994112:0@lo:400: 00000100:00100000:0.0:1783947341.044137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.044140:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604235993856:12345-0@lo:400: Request processed in 67us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947341.044145:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235994624:0@lo:400: 00000100:00100000:1.0:1783947341.044148:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947341.044163:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235994112 00000100:00100000:1.0:1783947341.044167:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235994112 00000100:00100000:1.0:1783947341.044180:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947341.044192:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604235994368:12345-0@lo:400: 00000100:00100000:1.0:1783947341.044222:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604235994368:12345-0@lo:400: Request processed in 31us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947341.044228:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947341.044241:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947341.044246:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604235994496:12345-0@lo:400: 00000100:00100000:1.0:1783947341.044272:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604235994496:12345-0@lo:400: Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947341.044278:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947341.044289:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947341.044294:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235994112:12345-0@lo:400: 00000100:00100000:1.0:1783947341.044318:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604235994112:12345-0@lo:400: Request processed in 24us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947341.044323:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947341.044358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993984 00000100:00100000:1.0:1783947341.044363:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993984 00000100:00100000:1.0:1783947341.044390:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783947341.044396:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235993984:12345-0@lo:400: 00000100:00100000:1.0:1783947341.044427:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235993984:12345-0@lo:400: Request processed in 31us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947341.044432:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783947341.044499:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235993984:0@lo:400: 00010000:00080000:1.0:1783947341.044513:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68700 x1870604235994496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947341.044524:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604235994496:0@lo:400: 00010000:00080000:1.0:1783947341.044544:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6a300 x1870604235993856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947341.044552:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604235993856:0@lo:400: 00010000:00080000:1.0:1783947341.044560:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6b480 x1870604235994368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947341.044567:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604235994368:0@lo:400: 00000100:00100000:0.0:1783947341.046334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783947341.046735:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6b100 x1870604235994112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947341.046751:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604235994112:0@lo:400: 00000100:00100000:0.0:1783947341.046767:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783947341.046780:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235993728:0@lo:400: 00000100:00100000:0.0:1783947341.046830:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947341.046853:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235994240:0@lo:400: 00000100:00100000:0.0:1783947341.046879:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947341.046900:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235994752:0@lo:400: 00000100:00100000:0.0:1783947341.046921:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.047012:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993728 00000100:00100000:1.0:1783947341.047019:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993728 00000100:00100000:1.0:1783947341.047080:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783947341.047091:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3637:x1870604235993728:12345-0@lo:400: 00000100:00100000:1.0:1783947341.047148:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3637:x1870604235993728:12345-0@lo:400: Request processed in 59us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947341.047155:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783947341.050589:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235993728:0@lo:400: 00000100:00100000:0.0:1783947341.050650:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993472 00000100:00100000:0.0:1783947341.050657:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993472 00000100:00100000:0.0:1783947341.050703:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235993600 00000100:00100000:0.0:1783947341.050714:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235993600 00000100:00100000:0.0:1783947341.050737:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947341.050745:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235993472:12345-0@lo:13: 00002000:00000024:0.0:1783947341.050785:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947341.051382:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235994624 00000100:00100000:2.0:1783947341.051389:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235994624 00000100:00100000:0.0:1783947341.051598:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1870604235993472:12345-0@lo:13: Request processed in 851us (7897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947341.051607:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947341.051634:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947341.051642:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235993600:12345-0@lo:13: 00002000:00000024:0.0:1783947341.051658:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947341.051699:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235993600:12345-0@lo:13: Request processed in 58us (7596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947341.051705:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783947341.051722:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947341.051727:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947341.051730:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783947341.051764:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc47a3b80 x1870604235993472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947341.051794:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783947341.051829:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235993472:0@lo:13: 00000100:00100000:0.0:1783947341.051867:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235994240 00000100:00100000:0.0:1783947341.051871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235994240 00000100:00100000:0.0:1783947341.051902:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947341.051909:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235994240:12345-0@lo:400: 00000100:00100000:0.0:1783947341.051950:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235994240:12345-0@lo:400: Request processed in 41us (5070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947341.051955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947341.051988:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235994240:0@lo:400: 00010000:00080000:0.0:1783947341.052000:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d69f80 x1870604235993600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947341.052014:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235993600:0@lo:13: 00000100:00100000:3.0:1783947341.053921:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235994752 00000100:00100000:3.0:1783947341.053932:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235994752 00000100:00100000:3.0:1783947341.054044:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947341.054066:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235994624:12345-0@lo:400: 00000100:00100000:3.0:1783947341.054157:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235994624:12345-0@lo:400: Request processed in 94us (7827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947341.054165:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947341.054182:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947341.054189:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235994752:12345-0@lo:400: 00000100:00100000:3.0:1783947341.054239:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604235994752:12345-0@lo:400: Request processed in 50us (7316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947341.054253:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783947341.054900:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6ad80 x1870604235994752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947341.054918:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235994752:0@lo:400: 00010000:00080000:2.0:1783947341.054935:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68000 x1870604235994624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947341.054944:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235994624:0@lo:400: 00000020:00000004:3.0:1783947341.196104:0:8855:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947341.196320:0:8855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783947341.556051:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235994880:0@lo:41: 00000100:00100000:1.0:1783947341.556143:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947341.556241:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235994880 00000100:00100000:1.0:1783947341.556251:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235994880 00000100:00100000:1.0:1783947341.556307:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783947341.556327:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235994880:12345-0@lo:41: 00000004:00000024:1.0:1783947341.556369:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783947341.556421:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235994880:12345-0@lo:41: Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947341.556429:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783947341.556505:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235994880:0@lo:41: 00000001:00080000:3.0:1783947341.575861:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1783947342.007129:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947343.027935:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947344.056254:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783947344.141988:0:8956:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947344.142837:0:8956:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783947344.628774:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947344.628815:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235995008:0@lo:41: 00000100:00100000:1.0:1783947344.628935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947344.629026:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995008 00000100:00100000:1.0:1783947344.629036:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995008 00000100:00100000:1.0:1783947344.629098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947344.629109:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235995008:12345-0@lo:41: 00000004:00000024:1.0:1783947344.629158:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783947344.629212:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604235995008:12345-0@lo:41: Request processed in 105us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947344.629221:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947344.629282:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604235995008:0@lo:41: 00010000:00010000:0.0:1783947345.084813:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783947345.262827:0:9004:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947345.262843:0:9004:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1783947346.099801:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947346.164787:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235995136:0@lo:13: 00000100:00100000:0.0:1783947346.164962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.165096:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995136 00000100:00100000:3.0:1783947346.165106:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995136 00000100:00100000:3.0:1783947346.165183:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947346.165206:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235995136:12345-0@lo:13: 00002000:00000024:3.0:1783947346.165243:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947346.165299:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604235995136:12345-0@lo:13: Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947346.165307:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783947346.165359:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc55bb480 x1870604235995136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947346.165370:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1783947346.165392:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604235995136:0@lo:13: 00000100:00080000:0.0:1783947346.166022:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947346.167173:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235995264:0@lo:400: 00000100:00100000:3.0:1783947346.168372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.168423:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235995776:0@lo:400: 00000100:00100000:3.0:1783947346.168472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.168507:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783947346.168513:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604235995648:0@lo:400: 00000100:00100000:3.0:1783947346.168543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.168563:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604235996160:0@lo:400: 00000100:00100000:3.0:1783947346.168605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.168649:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995264 00000100:00100000:3.0:1783947346.168658:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995264 00000100:00100000:3.0:1783947346.168721:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783947346.168730:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3638:x1870604235995264:12345-0@lo:400: 00000100:00100000:3.0:1783947346.168789:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3638:x1870604235995264:12345-0@lo:400: Request processed in 59us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947346.168798:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783947346.169345:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235995264:0@lo:400: 00000100:00100000:3.0:1783947346.170856:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235995520:0@lo:400: 00000100:00100000:3.0:1783947346.170946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.170993:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604235996032:0@lo:400: 00000100:00100000:3.0:1783947346.171026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.171053:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783947346.171060:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235995392:0@lo:400: 00000100:00100000:3.0:1783947346.171081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.171098:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604235995904:0@lo:400: 00000100:00100000:3.0:1783947346.171118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947346.172978:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996160 00000100:00100000:3.0:1783947346.172994:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996160 00000100:00100000:3.0:1783947346.173098:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947346.173109:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604235996160:12345-0@lo:400: 00000100:00100000:3.0:1783947346.173281:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604235996160:12345-0@lo:400: Request processed in 173us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947346.173290:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783947346.173355:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7ceb480 x1870604235996160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947346.173388:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604235996160:0@lo:400: 00000100:00080000:0.0:1783947346.179329:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947346.179530:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995648 00000100:00100000:0.0:1783947346.179544:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995648 00000100:00100000:0.0:1783947346.179598:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996032 00000100:00100000:0.0:1783947346.179602:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996032 00000100:00100000:0.0:1783947346.179629:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995392 00000100:00100000:0.0:1783947346.179645:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995392 00000100:00100000:0.0:1783947346.179662:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995904 00000100:00100000:0.0:1783947346.179665:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995904 00000100:00100000:0.0:1783947346.179691:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947346.179712:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604235995648:12345-0@lo:400: 00000100:00100000:0.0:1783947346.180029:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604235995648:12345-0@lo:400: Request processed in 328us (11483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947346.180037:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947346.180059:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947346.180065:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604235996032:12345-0@lo:400: 00000100:00100000:0.0:1783947346.180104:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604235996032:12345-0@lo:400: Request processed in 40us (9077us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947346.180111:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947346.180124:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947346.180130:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235995392:12345-0@lo:400: 00000100:00100000:0.0:1783947346.180160:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604235995392:12345-0@lo:400: Request processed in 30us (9078us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947346.180166:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947346.180178:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947346.180185:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604235995904:12345-0@lo:400: 00000100:00100000:0.0:1783947346.180225:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604235995904:12345-0@lo:400: Request processed in 41us (9105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947346.180231:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947346.180257:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995776 00000100:00100000:0.0:1783947346.180263:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995776 00000100:00100000:0.0:1783947346.180283:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235995520 00000100:00100000:0.0:1783947346.180286:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235995520 00000100:00100000:0.0:1783947346.180313:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947346.180319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235995776:12345-0@lo:400: 00000100:00100000:0.0:1783947346.180357:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235995776:12345-0@lo:400: Request processed in 38us (11885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947346.180363:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947346.180374:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947346.180379:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235995520:12345-0@lo:400: 00000100:00100000:0.0:1783947346.180405:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235995520:12345-0@lo:400: Request processed in 26us (9460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947346.180410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1783947346.180497:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947346.180501:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947346.180507:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947346.180522:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235996288:0@lo:13: 00000100:00100000:0.0:1783947346.180566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947346.180601:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996288 00000100:00100000:0.0:1783947346.180604:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996288 00000100:00100000:0.0:1783947346.180627:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947346.180632:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235996288:12345-0@lo:13: 00002000:00000024:0.0:1783947346.180649:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947346.180680:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235996288:12345-0@lo:13: Request processed in 48us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947346.180686:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783947346.180735:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6bb80 x1870604235996288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947346.180754:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235996288:0@lo:13: 00010000:00080000:0.0:1783947346.180792:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc55b8380 x1870604235995392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947346.180809:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604235995392:0@lo:400: 00010000:00080000:0.0:1783947346.180826:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7ceb100 x1870604235995904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947346.186167:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604235995904:0@lo:400: 00000100:00100000:0.0:1783947346.186214:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235995520:0@lo:400: 00010000:00080000:0.0:1783947346.186240:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7cebb80 x1870604235996032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947346.186252:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604235996032:0@lo:400: 00010000:00080000:0.0:1783947346.186330:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7cea300 x1870604235995648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947346.186340:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604235995648:0@lo:400: 00000100:00100000:0.0:1783947346.186354:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235995776:0@lo:400: 00000100:00100000:0.0:1783947346.688050:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235996416:0@lo:41: 00000100:00100000:0.0:1783947346.688157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947346.688348:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996416 00000100:00100000:1.0:1783947346.688360:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996416 00000100:00100000:1.0:1783947346.688429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947346.688441:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235996416:12345-0@lo:41: 00000004:00000024:1.0:1783947346.688507:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783947346.696098:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235996416:12345-0@lo:41: Request processed in 7641us (7923us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947346.696117:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947346.696963:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235996416:0@lo:41: 00010000:00010000:3.0:1783947347.128444:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947348.147790:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947349.173619:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947349.749906:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235996544:0@lo:41: 00000100:00100000:2.0:1783947349.750009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947349.750163:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996544 00000100:00100000:1.0:1783947349.750174:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996544 00000100:00100000:1.0:1783947349.750242:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947349.750253:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235996544:12345-0@lo:41: 00000004:00000024:1.0:1783947349.750308:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783947349.750369:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235996544:12345-0@lo:41: Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947349.750391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947349.750485:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235996544:0@lo:41: 00010000:00010000:1.0:1783947350.196649:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947351.219982:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947351.283658:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235996672:0@lo:13: 00000100:00100000:0.0:1783947351.283746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.283823:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996672 00000100:00100000:0.0:1783947351.283832:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996672 00000100:00100000:0.0:1783947351.283889:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947351.283899:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235996672:12345-0@lo:13: 00002000:00000024:0.0:1783947351.283943:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947351.283990:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604235996672:12345-0@lo:13: Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.283998:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1783947351.284019:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947351.284051:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68000 x1870604235996672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947351.284072:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604235996672:0@lo:13: 00000100:00100000:0.0:1783947351.285683:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235996928:0@lo:400: 00000100:00100000:0.0:1783947351.285755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.285799:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235997440:0@lo:400: 00000100:00100000:0.0:1783947351.285829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.285853:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783947351.285859:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604235997056:0@lo:400: 00000100:00100000:0.0:1783947351.285888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.285905:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604235997568:0@lo:400: 00000100:00100000:0.0:1783947351.285930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.285975:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996928 00000100:00100000:0.0:1783947351.285983:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996928 00000100:00100000:0.0:1783947351.286028:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783947351.286038:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3639:x1870604235996928:12345-0@lo:400: 00000100:00100000:0.0:1783947351.286093:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3639:x1870604235996928:12345-0@lo:400: Request processed in 57us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.286100:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783947351.286134:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997440 00000100:00100000:0.0:1783947351.286146:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997440 00000100:00100000:0.0:1783947351.286186:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783947351.286192:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1783947351.286193:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235997440:12345-0@lo:400: 00000100:00100000:2.0:1783947351.286205:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1783947351.286249:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604235997440:12345-0@lo:400: Request processed in 56us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.286255:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947351.286277:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997056 00000100:00100000:0.0:1783947351.286281:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997056 00000100:00100000:0.0:1783947351.286837:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997568 00000100:00100000:0.0:1783947351.286842:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997568 00000100:00100000:0.0:1783947351.286868:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947351.286874:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604235997056:12345-0@lo:400: 00000100:00100000:0.0:1783947351.286914:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604235997056:12345-0@lo:400: Request processed in 40us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.286920:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947351.286932:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947351.286938:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604235997568:12345-0@lo:400: 00000100:00100000:0.0:1783947351.287883:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604235997568:12345-0@lo:400: Request processed in 939us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.287893:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947351.288910:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235996800:0@lo:13: 00000100:00100000:0.0:1783947351.289544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.289586:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604235997312:0@lo:400: 00000100:00100000:0.0:1783947351.289627:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.289646:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235997824:0@lo:400: 00000100:00100000:0.0:1783947351.289669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.289695:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783947351.289709:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604235997184:0@lo:400: 00000100:00100000:0.0:1783947351.289747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.289764:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604235997696:0@lo:400: 00000100:00100000:0.0:1783947351.289782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947351.289814:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997824 00000100:00100000:0.0:1783947351.289821:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997824 00000100:00100000:0.0:1783947351.289871:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947351.289878:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235997824:12345-0@lo:400: 00000100:00100000:0.0:1783947351.289927:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235997824:12345-0@lo:400: Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.289935:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947351.290216:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997312 00000100:00100000:0.0:1783947351.291502:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997312 00000100:00100000:0.0:1783947351.291548:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997696 00000100:00100000:0.0:1783947351.291551:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997696 00000100:00100000:0.0:1783947351.291575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947351.291582:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604235997312:12345-0@lo:400: 00000100:00100000:0.0:1783947351.291663:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604235997312:12345-0@lo:400: Request processed in 81us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.291671:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947351.291685:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947351.291691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604235997696:12345-0@lo:400: 00000100:00100000:0.0:1783947351.291717:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604235997696:12345-0@lo:400: Request processed in 27us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.291723:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783947351.291761:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947351.291765:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947351.291768:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947351.291798:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997184 00000100:00100000:0.0:1783947351.291802:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997184 00000100:00100000:0.0:1783947351.291820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947351.291826:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604235997184:12345-0@lo:400: 00000100:00100000:0.0:1783947351.291857:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604235997184:12345-0@lo:400: Request processed in 32us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.291863:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947351.291885:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235996800 00000100:00100000:0.0:1783947351.291890:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235996800 00000100:00100000:0.0:1783947351.291916:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947351.291921:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235996800:12345-0@lo:13: 00002000:00000024:0.0:1783947351.291938:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947351.291982:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604235996800:12345-0@lo:13: Request processed in 60us (2439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947351.291989:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783947351.292046:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6b480 x1870604235997056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947351.292063:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604235997056:0@lo:400: 00010000:00080000:0.0:1783947351.292078:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6aa00 x1870604235997568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947351.292087:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604235997568:0@lo:400: 00000100:00100000:0.0:1783947351.292099:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235996928:0@lo:400: 00000100:00100000:0.0:1783947351.292112:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604235997440:0@lo:400: 00000100:00100000:0.0:1783947351.292156:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604235997184:0@lo:400: 00010000:00080000:0.0:1783947351.292167:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc47a3b80 x1870604235997696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947351.292184:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604235997696:0@lo:400: 00010000:00080000:0.0:1783947351.292198:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7ceb480 x1870604235996800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947351.292211:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235996800:0@lo:13: 00010000:00080000:0.0:1783947351.292221:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68700 x1870604235997312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947351.294108:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604235997312:0@lo:400: 00010000:00080000:0.0:1783947351.294144:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc4744a80 x1870604235997824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947351.294153:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604235997824:0@lo:400: 00000100:00100000:1.0:1783947351.797731:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947351.803966:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604235997952:0@lo:41: 00000100:00100000:0.0:1783947351.804362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947351.804436:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235997952 00000100:00100000:2.0:1783947351.804451:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235997952 00000100:00100000:2.0:1783947351.804562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947351.804575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604235997952:12345-0@lo:41: 00000004:00000024:2.0:1783947351.804637:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783947351.804744:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604235997952:12345-0@lo:41: Request processed in 171us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947351.804752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783947351.805102:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604235997952:0@lo:41: 00010000:00010000:3.0:1783947352.244651:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947353.272064:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947354.301990:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947354.867668:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235998080:0@lo:41: 00000100:00100000:0.0:1783947354.867782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947354.867956:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998080 00000100:00100000:3.0:1783947354.867967:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998080 00000100:00100000:3.0:1783947354.868032:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947354.868044:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235998080:12345-0@lo:41: 00000004:00000024:3.0:1783947354.868090:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1783947354.868888:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604235998080:12345-0@lo:41: Request processed in 842us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947354.868899:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783947354.869096:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604235998080:0@lo:41: 00000020:01000004:2.0:1783947355.250605:0:9505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783947355.250609:0:9505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783947355.250611:0:9505:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783947355.250775:0:9505:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7bc47c2000 00000020:01000004:2.0:1783947355.250793:0:9505:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783947355.250810:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783947355.250835:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e7ac66f3380) 00000020:00000080:2.0:1783947355.250855:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783947355.310962:0:9505:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783947355.311026:0:9505:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:0.0:1783947355.318820:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:3.0:1783947355.344914:0:9505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783947355.345237:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783947355.345255:0:9505:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783947355.345270:0:9505:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6fd1fdb554fffcc 00000020:01000004:3.0:1783947355.345283:0:9505:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783947355.345308:0:9505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783947355.345312:0:9505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783947355.345319:0:9505:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783947355.345637:0:9505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783947355.345642:0:9505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783947355.367734:0:9505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947355.367782:0:9505:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783947355.367788:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947355.367790:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947355.367791:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947355.367792:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947355.367794:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947355.367795:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947355.367797:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947355.367798:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947355.367800:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947355.367802:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947355.367803:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947355.367808:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783947355.367810:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947355.367812:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947355.367814:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947355.367815:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947355.367816:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947355.367817:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947355.367819:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947355.367820:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947355.367821:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947355.367822:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947355.367823:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947355.367862:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783947355.367889:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604235998208:0@lo:253: 00000100:00100000:1.0:1783947355.367984:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.368110:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947355.368166:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998208 00000100:00100000:3.0:1783947355.368174:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998208 00000100:00100000:3.0:1783947355.368310:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783947355.368321:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:9505:x1870604235998208:12345-0@lo:253: 20000000:01000000:3.0:1783947355.368366:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783947355.368370:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1783947355.368376:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1783947355.368380:0:6504:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783947355.369176:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947355.369438:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1783947355.369811:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783947355.369839:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1783947355.369847:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783947355.369861:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1783947355.369877:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1783947355.370005:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1783947355.370101:0:6504:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:1.0:1783947355.370103:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:1.0:1783947355.370121:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1783947355.370127:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783947355.370140:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1783947355.370145:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:1.0:1783947355.370157:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1783947355.370164:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783947355.370182:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1783947355.370199:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1783947355.370280:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1783947355.370292:0:6504:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:1.0:1783947355.370293:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:1.0:1783947355.370307:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1783947355.370312:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783947355.370325:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1783947355.370330:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:1.0:1783947355.370341:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1783947355.370346:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783947355.370423:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1783947355.370447:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1783947355.370876:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1783947355.370890:0:6504:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.103@tcp 20000000:01000000:1.0:1783947355.370898:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.103@tcp (null) (null) (null) 00000040:00080000:1.0:1783947355.370914:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1783947355.370920:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783947355.370933:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1783947355.370937:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.103@tcp (null) (null) 00000040:00080000:1.0:1783947355.370951:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1783947355.370957:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783947355.370971:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1783947355.370987:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1783947355.371002:0:6504:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783947355.371006:0:6504:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783947355.371080:0:6504:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783947355.371141:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783947355.371144:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783947355.371757:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1783947355.372003:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1783947355.372104:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1783947355.372123:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1783947355.372135:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783947355.372137:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783947355.372828:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1783947355.372859:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1783947355.373090:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1783947355.373281:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1783947355.373306:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1783947355.373319:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1783947355.373331:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783947355.373333:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783947355.373852:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1783947355.373874:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1783947355.373890:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1783947355.374050:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1783947355.374070:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1783947355.374085:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1783947355.374098:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783947355.374100:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783947355.374687:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1783947355.374723:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1783947355.374735:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1783947355.374929:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1783947355.374952:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1783947355.374967:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1783947355.374978:0:6504:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783947355.374980:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783947355.377322:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1783947355.377409:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1783947355.377428:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1783947355.378209:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1783947355.378240:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1783947355.378256:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1783947355.378289:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783947355.378314:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378335:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378344:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378351:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378357:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378364:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378395:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378403:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378412:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378754:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.378771:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 21 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.378788:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998336:0@lo:104: 00000100:00100000:3.0:1783947355.378892:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947355.378994:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.379003:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 21 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.379025:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998464:0@lo:104: 00000100:00100000:3.0:1783947355.379051:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947355.379255:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.379264:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 21 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.379284:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998592:0@lo:104: 00000100:00100000:3.0:1783947355.379306:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.379328:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998336 00000100:00100000:1.0:1783947355.379335:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998336 00000100:00100000:0.0:1783947355.379392:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998464 00000100:00100000:0.0:1783947355.379396:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998464 00000100:00100000:0.0:1783947355.379422:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947355.379431:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6504:x1870604235998336:12345-0@lo:104: 00010000:00010000:0.0:1783947355.379447:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.379553:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947355.379560:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6504:x1870604235998336:12345-0@lo:104: Request processed in 130us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.379567:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947355.379586:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947355.379591:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6504:x1870604235998464:12345-0@lo:104: 00010000:00010000:0.0:1783947355.379598:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.379627:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783947355.379631:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6504:x1870604235998464:12345-0@lo:104: Request processed in 41us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.379636:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1783947355.379652:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947355.379658:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.379665:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c2400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947355.379670:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.379805:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947355.379812:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.379818:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.379821:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.379840:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.379846:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.379852:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947355.379881:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.379886:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947355.379903:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.379909:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb554fff8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.379918:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947355.379920:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947355.379921:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947355.379957:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947355.379963:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947355.379968:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947355.379994:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.380000:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947355.380006:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.380116:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2400/0xe6fd1fdb554fffb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fffb7 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.380127:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947355.380129:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947355.380131:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947355.380146:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235998720:0@lo:103: 00000100:00100000:0.0:1783947355.380182:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.380215:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947355.380221:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235998848:0@lo:103: 00000100:00100000:0.0:1783947355.380243:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.380306:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998720 00000100:00100000:2.0:1783947355.380311:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998720 00010000:00010000:2.0:1783947355.380335:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 22 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.380366:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998848 00000100:00100000:2.0:1783947355.380369:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998848 00010000:00010000:2.0:1783947355.380382:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 23 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.380401:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947355.380416:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3637:x1870604235998720:12345-0@lo:103: 00010000:00010000:2.0:1783947355.380428:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947355.380435:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 23 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.380445:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 23 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.380487:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947355.380534:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3637:x1870604235998720:12345-0@lo:103: Request processed in 109us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.380542:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947355.380558:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947355.380565:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3637:x1870604235998848:12345-0@lo:103: 00010000:00010000:2.0:1783947355.380574:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947355.380578:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 22 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.380587:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 22 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.380597:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947355.380617:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3637:x1870604235998848:12345-0@lo:103: Request processed in 53us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.380624:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947355.380666:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235998848:0@lo:103: 00000100:00100000:2.0:1783947355.380675:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604235998720:0@lo:103: 00010000:00010000:3.0:1783947355.380932:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.380945:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 21 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.380954:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998976:0@lo:104: 00000100:00100000:3.0:1783947355.380981:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947355.380999:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.381007:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 21 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.381029:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235999104:0@lo:104: 00000100:00100000:3.0:1783947355.381049:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947355.381066:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.381074:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 21 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.381081:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235999232:0@lo:104: 00000100:00100000:3.0:1783947355.381103:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947355.381119:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.381139:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 21 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.381147:0:6504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235999360:0@lo:104: 00000100:00100000:3.0:1783947355.381168:0:6504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5535000 going to sleep for 11 seconds 00010000:00010000:3.0:1783947355.381182:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c3200/0xe6fd1fdb554fffb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fffb0 expref: 21 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.381194:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998336:0@lo:104: 00010000:00010000:3.0:1783947355.381205:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb554fff94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fff8d expref: 20 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.381214:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998464:0@lo:104: 00000100:00100000:1.0:1783947355.381380:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783947355.381400:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.381412:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998592 00000100:00100000:1.0:1783947355.381416:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998592 00000100:00100000:1.0:1783947355.381441:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235998976 00000100:00100000:1.0:1783947355.381443:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235998976 00000100:00100000:1.0:1783947355.381452:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235999104 00000100:00100000:1.0:1783947355.381480:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235999104 00000100:00100000:1.0:1783947355.381495:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235999232 00000100:00100000:1.0:1783947355.381498:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235999232 00000100:00100000:1.0:1783947355.381507:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235999360 00000100:00100000:1.0:1783947355.381509:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235999360 00000100:00100000:1.0:1783947355.381520:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947355.381538:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+7:6504:x1870604235998592:12345-0@lo:104: 00010000:00010000:1.0:1783947355.381551:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.381604:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947355.381610:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+7:6504:x1870604235998592:12345-0@lo:104: Request processed in 84us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.381617:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947355.381634:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947355.381640:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:6504:x1870604235998976:12345-0@lo:104: 00010000:00010000:1.0:1783947355.381648:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.381690:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947355.381704:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:6504:x1870604235998976:12345-0@lo:104: Request processed in 64us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.381710:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947355.381723:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947355.381728:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:6504:x1870604235999104:12345-0@lo:104: 00010000:00010000:1.0:1783947355.381736:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.381771:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783947355.381776:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:6504:x1870604235999104:12345-0@lo:104: Request processed in 48us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.381781:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947355.381791:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947355.381796:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6504:x1870604235999232:12345-0@lo:104: 00010000:00010000:1.0:1783947355.381804:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.381828:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783947355.381832:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5845450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:6504:x1870604235999232:12345-0@lo:104: Request processed in 36us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.381838:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947355.381874:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947355.381881:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6504:x1870604235999360:12345-0@lo:104: 00010000:00010000:1.0:1783947355.381889:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.381914:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783947355.381925:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6504:x1870604235999360:12345-0@lo:104: Request processed in 46us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.381931:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1783947355.382074:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783947355.382086:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382093:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.382098:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382107:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.382114:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.382120:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947355.382160:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382167:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947355.382189:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382197:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb554fff71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382210:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783947355.382214:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382220:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.382223:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382240:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.382247:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.382252:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947355.382267:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382273:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947355.382278:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382285:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e800/0xe6fd1fdb554fff47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382294:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783947355.382297:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382302:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.382305:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382312:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.382318:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.382330:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947355.382344:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382350:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947355.382366:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382373:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb554fff2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382382:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947355.382385:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382391:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.382394:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382400:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.382407:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.382412:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947355.382424:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382430:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947355.382441:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382448:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb554ffeec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffef3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382485:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947355.382488:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382495:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.382498:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382504:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.382510:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.382516:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947355.382541:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382548:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947355.382553:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382559:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554ffec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffec9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.382573:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947355.382581:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947355.382583:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947355.382602:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235999488:0@lo:103: 00000100:00100000:2.0:1783947355.382644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.382897:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236000000:0@lo:103: 00000100:00100000:2.0:1783947355.382926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.382988:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947355.382994:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235999616:0@lo:103: 00000100:00100000:2.0:1783947355.383024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947355.383231:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947355.383260:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947355.383367:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235999872:0@lo:103: 00000100:00100000:2.0:1783947355.383393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.383444:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235999488 00000100:00100000:1.0:1783947355.383452:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235999488 00010000:00010000:1.0:1783947355.383515:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 20 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947355.383551:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000000 00000100:00100000:1.0:1783947355.383555:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000000 00010000:00010000:1.0:1783947355.383567:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 21 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947355.383578:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235999616 00000100:00100000:1.0:1783947355.383580:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235999616 00010000:00010000:1.0:1783947355.383588:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 22 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947355.383600:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947355.383607:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3639:x1870604235999488:12345-0@lo:103: 00010000:00010000:1.0:1783947355.383620:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947355.383625:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 22 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.383637:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 22 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.383657:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947355.383874:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235999872 00000100:00100000:0.0:1783947355.383879:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235999872 00010000:00010000:0.0:1783947355.383898:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 23 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947355.383914:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947355.383919:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc649b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3639:x1870604236000000:12345-0@lo:103: 00010000:00010000:0.0:1783947355.383926:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947355.383930:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 23 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.383951:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 23 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.383961:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947355.384024:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947355.384031:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235999744:0@lo:103: 00000100:00100000:2.0:1783947355.384073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.384124:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783947355.384133:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1783947355.384265:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604235999744 00000100:00100000:2.0:1783947355.384269:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604235999744 00010000:00010000:2.0:1783947355.384285:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 24 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.384300:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783947355.384307:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947355.384312:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604235999616:12345-0@lo:103: 00010000:00010000:2.0:1783947355.384321:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947355.384325:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 24 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384344:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 24 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384354:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947355.384385:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604235999616:12345-0@lo:103: Request processed in 71us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.384392:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947355.384409:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783947355.384415:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947355.384421:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3638:x1870604235999872:12345-0@lo:103: 00010000:00010000:2.0:1783947355.384429:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947355.384434:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 23 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384441:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 23 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384451:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947355.384514:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3638:x1870604235999872:12345-0@lo:103: Request processed in 93us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.384520:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947355.384543:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783947355.384550:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947355.384555:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3638:x1870604235999744:12345-0@lo:103: 00010000:00010000:2.0:1783947355.384575:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947355.384580:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 22 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384599:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 22 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384613:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384623:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384639:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384646:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384653:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384660:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384666:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bc0031e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947355.384671:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384693:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384703:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.384724:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947355.384749:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3638:x1870604235999744:12345-0@lo:103: Request processed in 193us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.384756:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947355.384799:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235999744:0@lo:103: 00000100:00100000:2.0:1783947355.384810:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604235999872:0@lo:103: 00000100:00100000:1.0:1783947355.385282:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3639:x1870604235999488:12345-0@lo:103: Request processed in 1673us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.385290:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783947355.385402:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235999488:0@lo:103: 00000100:00100000:2.0:1783947355.385419:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604235999616:0@lo:103: 00010000:00010000:3.0:1783947355.385567:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb554fff78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fff71 expref: 20 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.385581:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998592:0@lo:104: 00010000:00010000:3.0:1783947355.385595:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb554fff4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fff47 expref: 19 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.385605:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235998976:0@lo:104: 00010000:00010000:3.0:1783947355.385616:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb554fff32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fff2b expref: 18 pid: 6503 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.385625:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cebb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235999104:0@lo:104: 00010000:00010000:3.0:1783947355.385636:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb554ffef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffeec expref: 17 pid: 6504 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.385657:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235999232:0@lo:104: 00010000:00010000:3.0:1783947355.385671:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb554ffec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffec2 expref: 16 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.385799:0:6504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1870604235999360:0@lo:104: 00010000:00010000:3.0:1783947355.385832:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.385843:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.385850:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.385857:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bc0031e00/0xe6fd1fdb554fffd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947355.385876:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783947355.386036:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc649b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3639:x1870604236000000:12345-0@lo:103: Request processed in 2115us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.386045:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947355.386225:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236000000:0@lo:103: 00000100:00100000:3.0:1783947355.388517:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+14:9505:x1870604235998208:12345-0@lo:253: Request processed in 20183us (20518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.388858:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604235998208:0@lo:253: 10000000:01000000:1.0:1783947355.388876:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783947355.388880:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947355.388882:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947355.388883:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947355.388884:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783947355.388886:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947355.388887:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947355.388888:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947355.388890:0:9505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783947355.388892:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947355.388893:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947355.388921:0:9505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7bc47c2000 from lustre-OST0001 10000000:01000000:1.0:1783947355.388960:0:9505:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783947355.388963:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783947355.388973:0:9505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7bc5510000 local copy 10000000:01000000:1.0:1783947355.388978:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947355.389024:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.389037:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.389047:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947355.389068:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000128:0@lo:101: 00000100:00100000:1.0:1783947355.389117:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.389159:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947355.389607:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000128 00000100:00100000:0.0:1783947355.389616:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000128 00000100:00100000:0.0:1783947355.389680:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783947355.389691:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000128:12345-0@lo:101: 00010000:00010000:0.0:1783947355.389709:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947355.389727:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb554fffe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fffda expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.389755:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb554fffe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffda expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.389766:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb554fffe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffda expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.389777:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ac00, rc 0) 00000100:00100000:0.0:1783947355.389834:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236000128:12345-0@lo:101: Request processed in 145us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.389841:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783947355.390124:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000128:0@lo:101: 00010000:00010000:2.0:1783947355.390141:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.390151:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.390305:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000256:0@lo:501: 00000100:00100000:2.0:1783947355.390344:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.390388:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947355.390503:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000256 00000100:00100000:1.0:1783947355.390509:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000256 00000100:00100000:1.0:1783947355.390558:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783947355.390565:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236000256:12345-0@lo:501: 00000100:00100000:3.0:1783947355.390712:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783947355.391883:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000256:12345-0@lo:501: Request processed in 1312us (1532us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947355.391895:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783947355.391982:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000256:0@lo:501: 10000000:01000000:2.0:1783947355.392005:0:9505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783947355.392040:0:9505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783947355.392049:0:9505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.392104:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.392112:0:9505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.392141:0:9505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783947355.392270:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7bc47c2000 10000000:01000000:2.0:1783947355.392277:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783947355.392284:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783947355.392287:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947355.392291:0:9505:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783947355.392295:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783947355.392327:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.392335:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.392346:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.392346:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947355.392355:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.392374:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c2a00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947355.392378:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.392387:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947355.392394:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947355.392400:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947355.392423:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.392430:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947355.392486:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.392495:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb554fffda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe6fd1fdb554fffe1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.392508:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947355.392510:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947355.392512:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947355.392599:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947355.392618:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236000512:0@lo:103: 00000100:00100000:3.0:1783947355.392676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.393083:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000384:0@lo:101: 00000100:00100000:2.0:1783947355.393120:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.393145:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000512 00000100:00100000:2.0:1783947355.393147:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947355.393153:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000512 00000100:00100000:0.0:1783947355.393207:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947355.393216:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3639:x1870604236000512:12345-0@lo:103: 00010000:00010000:0.0:1783947355.393230:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947355.393258:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb554fffe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb554fffda expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947355.393276:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947355.393277:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000384 00000100:00100000:3.0:1783947355.393282:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000384 00000100:00100000:3.0:1783947355.393311:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783947355.393319:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000384:12345-0@lo:101: 00000100:00100000:0.0:1783947355.393325:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3639:x1870604236000512:12345-0@lo:103: Request processed in 111us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.393332:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783947355.393338:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947355.393353:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb554fffe8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947355.393497:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236000512:0@lo:103: 00010000:00010000:3.0:1783947355.393862:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.393878:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.393886:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bc0030400, rc 0) 00000100:00100000:3.0:1783947355.393973:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000384:12345-0@lo:101: Request processed in 653us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947355.393980:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783947355.394149:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000384:0@lo:101: 00010000:00010000:2.0:1783947355.394164:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.394187:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.394614:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000640:0@lo:501: 00000100:00100000:2.0:1783947355.394655:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.394689:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947355.394957:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000640 00000100:00100000:1.0:1783947355.394965:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000640 00000100:00100000:1.0:1783947355.395024:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783947355.395033:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000640:12345-0@lo:501: 00000100:00100000:1.0:1783947355.395199:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000640:12345-0@lo:501: Request processed in 166us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.395207:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947355.395231:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000640:0@lo:501: 00000100:00100000:2.0:1783947355.395262:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000768:0@lo:503: 00000100:00100000:2.0:1783947355.395311:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.395343:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947355.395350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000768 00000100:00100000:0.0:1783947355.395355:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000768 00000100:00100000:0.0:1783947355.395388:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783947355.395396:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000768:12345-0@lo:503: 00000100:00100000:0.0:1783947355.395540:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000768:12345-0@lo:503: Request processed in 145us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.395547:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783947355.395615:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000768:0@lo:503: 00000040:00080000:2.0:1783947355.395954:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947355.396040:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000896:0@lo:502: 00000100:00100000:2.0:1783947355.396080:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.396716:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947355.398445:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236000896 00000100:00100000:3.0:1783947355.398475:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236000896 00000100:00100000:3.0:1783947355.398566:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783947355.398579:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000896:12345-0@lo:502: 00000100:00100000:2.0:1783947355.399273:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236000896:12345-0@lo:502: Request processed in 694us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.399285:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783947355.400194:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236000896:0@lo:502: 00000040:00080000:1.0:1783947355.400572:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783947355.400607:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783947355.400621:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783947355.400632:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783947355.400642:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783947355.400653:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783947355.400694:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001024:0@lo:502: 00000100:00100000:1.0:1783947355.400769:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.400884:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947355.400998:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001024 00000100:00100000:0.0:1783947355.401005:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001024 00000100:00100000:0.0:1783947355.401094:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947355.401104:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236001024:12345-0@lo:502: 00000100:00100000:0.0:1783947355.401250:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236001024:12345-0@lo:502: Request processed in 146us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.401258:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783947355.401343:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001024:0@lo:502: 00000040:00080000:2.0:1783947355.401398:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783947355.401409:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1783947355.401978:0:9517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947355.401988:0:9517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1783947355.401994:0:9517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947355.401996:0:9517:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783947355.402010:0:9517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947355.402029:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e7ac66f0000) 00000020:00000080:2.0:1783947355.402071:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783947355.402079:0:9517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947355.402176:0:9517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bc47c2000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783947355.402186:0:9517:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947355.402194:0:9517:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6fd1fdb554ffffd 00010000:00010000:2.0:1783947355.407272:0:9517:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1783947355.408176:0:9517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783947355.410879:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783947355.411411:0:9517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783947355.416114:0:9517:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783947355.416339:0:9517:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1783947355.421621:0:9517:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783947355.422832:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783947355.422849:0:9517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947355.422857:0:9517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947355.422860:0:9517:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783947355.422864:0:9517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947355.422868:0:9517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947355.422870:0:9517:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947355.422874:0:9517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947355.422876:0:9517:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947355.422906:0:9517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947355.422909:0:9517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947355.422910:0:9517:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783947355.422914:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783947355.425538:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783947355.425620:0:9505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783947355.425654:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.425692:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.425701:0:9505:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc47c2000 from 1 10000000:01000000:2.0:1783947355.425704:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947355.425765:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.425778:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.425791:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.425826:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7145880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001152:0@lo:101: 00000100:00100000:2.0:1783947355.425936:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.426002:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947355.426189:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001152 00000100:00100000:2.0:1783947355.426199:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001152 00000100:00100000:2.0:1783947355.427113:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783947355.427126:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:9505:x1870604236001152:12345-0@lo:101: 00010000:00010000:2.0:1783947355.427145:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947355.427169:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500004 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.427202:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.427210:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.427227:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e800, rc 0) 00000100:00100000:2.0:1783947355.427291:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001152:12345-0@lo:101: Request processed in 170us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.427297:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783947355.427448:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7145880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001152:0@lo:101: 00010000:00010000:3.0:1783947355.427489:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.427497:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.427641:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001280:0@lo:501: 00000100:00100000:3.0:1783947355.427673:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.428676:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947355.428733:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001280 00000100:00100000:1.0:1783947355.428743:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001280 00000100:00100000:1.0:1783947355.428791:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783947355.428801:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001280:12345-0@lo:501: 00000100:00100000:1.0:1783947355.429185:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001280:12345-0@lo:501: Request processed in 384us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.429193:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783947355.429307:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001280:0@lo:501: 00000100:00100000:3.0:1783947355.429361:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001408:0@lo:503: 00000100:00100000:3.0:1783947355.429408:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.429501:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947355.429773:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001408 00000100:00100000:2.0:1783947355.429780:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001408 00000100:00100000:2.0:1783947355.429860:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783947355.429868:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001408:12345-0@lo:503: 00000100:00100000:2.0:1783947355.430024:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001408:12345-0@lo:503: Request processed in 157us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.430032:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783947355.430179:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001408:0@lo:503: 00000040:00080000:3.0:1783947355.430540:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947355.430641:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001536:0@lo:502: 00000100:00100000:3.0:1783947355.430681:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.430772:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947355.430828:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001536 00000100:00100000:2.0:1783947355.430833:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001536 00000100:00100000:2.0:1783947355.430873:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783947355.430881:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001536:12345-0@lo:502: 00000100:00100000:2.0:1783947355.430971:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001536:12345-0@lo:502: Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.430978:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783947355.431116:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001536:0@lo:502: 00000040:00080000:3.0:1783947355.431350:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783947355.431377:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783947355.431400:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001664:0@lo:502: 00000100:00100000:3.0:1783947355.431435:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.431478:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947355.431496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001664 00000100:00100000:3.0:1783947355.431501:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001664 00000100:00100000:3.0:1783947355.431538:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783947355.431546:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001664:12345-0@lo:502: 00000100:00100000:3.0:1783947355.431626:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001664:12345-0@lo:502: Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947355.431632:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783947355.431674:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001664:0@lo:502: 00000040:00080000:3.0:1783947355.431713:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1783947355.431721:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783947355.432267:0:9521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947355.432278:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947355.432280:0:9521:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783947355.432287:0:9521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bc47c2000 00000020:00000080:2.0:1783947355.432290:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947355.432303:0:9521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947355.432305:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947355.432307:0:9521:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783947355.432309:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783947355.433841:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783947355.433894:0:9505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947355.433960:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.433975:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947355.434062:0:9505:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783947355.434065:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7bc47c2000 10000000:01000000:3.0:1783947355.434069:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7bc47c2000 10000000:01000000:3.0:1783947355.434073:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783947355.434080:0:9505:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc47c2000 from 1 10000000:01000000:3.0:1783947355.434083:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783947355.434125:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.434134:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.434146:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.434171:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001792:0@lo:101: 00000100:00100000:3.0:1783947355.434246:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.434296:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947355.434577:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001792 00000100:00100000:2.0:1783947355.434586:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001792 00000100:00100000:2.0:1783947355.434631:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783947355.434639:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9505:x1870604236001792:12345-0@lo:101: 00010000:00010000:2.0:1783947355.434654:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947355.434672:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500012 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.434698:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.434709:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.434719:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e200, rc 0) 00000100:00100000:2.0:1783947355.434765:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236001792:12345-0@lo:101: Request processed in 126us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.434772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783947355.434975:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001792:0@lo:101: 00010000:00010000:3.0:1783947355.434990:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.435000:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.435117:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001920:0@lo:501: 00000100:00100000:3.0:1783947355.435144:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.435176:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947355.435275:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236001920 00000100:00100000:2.0:1783947355.435279:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236001920 00000100:00100000:2.0:1783947355.435313:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783947355.435319:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236001920:12345-0@lo:501: 00000100:00100000:2.0:1783947355.435441:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236001920:12345-0@lo:501: Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.435448:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783947355.435691:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236001920:0@lo:501: 00000100:00100000:3.0:1783947355.435722:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236002048:0@lo:503: 00000100:00100000:3.0:1783947355.435768:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.435796:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947355.437252:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002048 00000100:00100000:0.0:1783947355.437266:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002048 00000100:00100000:0.0:1783947355.437383:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783947355.437394:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236002048:12345-0@lo:503: 00000100:00100000:0.0:1783947355.437903:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236002048:12345-0@lo:503: Request processed in 508us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.437912:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783947355.438061:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236002048:0@lo:503: 00000040:00080000:3.0:1783947355.438364:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783947355.438514:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236002176:0@lo:502: 00000100:00100000:3.0:1783947355.438581:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.440483:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002176 00000100:00100000:2.0:1783947355.440501:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002176 00000100:00100000:2.0:1783947355.440573:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783947355.440584:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236002176:12345-0@lo:502: 00000100:00100000:2.0:1783947355.440778:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236002176:12345-0@lo:502: Request processed in 196us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.440787:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783947355.440913:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947355.440940:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236002176:0@lo:502: 00000040:00080000:3.0:1783947355.442071:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783947355.442114:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783947355.442125:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783947355.442136:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783947355.442147:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783947355.442157:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783947355.442168:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783947355.442178:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783947355.442190:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783947355.442224:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783947355.442239:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783947355.442253:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783947355.442266:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783947355.442289:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783947355.442300:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783947355.442311:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783947355.442322:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783947355.442333:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783947355.442343:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783947355.442562:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783947355.442584:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783947355.442595:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783947355.442604:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783947355.442614:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783947355.442624:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783947355.442645:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783947355.442658:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783947355.442668:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783947355.442677:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783947355.442690:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783947355.442704:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783947355.442716:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783947355.442728:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783947355.442740:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783947355.442754:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783947355.442766:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783947355.442780:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1783947355.442793:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783947355.442804:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1783947355.442816:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1783947355.442828:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1783947355.442856:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1783947355.442872:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1783947355.442885:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1783947355.442896:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1783947355.442907:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1783947355.442962:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236002304:0@lo:502: 00000100:00100000:3.0:1783947355.443838:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.443914:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947355.444247:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002304 00000100:00100000:0.0:1783947355.444259:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002304 00000100:00100000:2.0:1783947355.444335:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783947355.444350:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236002304:12345-0@lo:502: 00000100:00100000:2.0:1783947355.444711:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236002304:12345-0@lo:502: Request processed in 363us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.444720:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783947355.444875:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236002304:0@lo:502: 00000040:00080000:3.0:1783947355.444966:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1783947355.444982:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1783947355.445758:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783947355.445776:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e7bf7f719c0) 00000020:00000080:3.0:1783947355.445809:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1783947355.446126:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bc47c2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783947355.446131:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc47c2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783947355.446133:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc47c2000 3 00010000:00080000:3.0:1783947355.446165:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac73ca800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947355.452890:0:9522:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1783947355.453022:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783947355.453084:0:9522:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947355.453100:0:9522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe6fd1fdb55500027 00000100:00080000:3.0:1783947355.453114:0:9522:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947355.453121:0:9522:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7ac73ca800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947355.453170:0:9522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bc55bb480 x1870604236002432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947355.454715:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236002432:0@lo:38: 00000100:00100000:1.0:1783947355.454823:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947355.454933:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783947355.458713:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002432 00000100:00100000:0.0:1783947355.458729:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002432 00000100:00100000:0.0:1783947355.458796:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947355.458805:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1870604236002432:12345-0@lo:38: 00010000:00080000:0.0:1783947355.458842:0:6511:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1783947355.458886:0:6511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe6fd1fdb5550002e 00000004:00100000:0.0:1783947355.458908:0:6511:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783947355.458951:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9e7be7949000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947355.459344:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870604236002432:12345-0@lo:38: Request processed in 538us (4519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.459353:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947355.459536:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236002688:0@lo:400: 00000100:00100000:0.0:1783947355.459582:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.459608:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236003200:0@lo:400: 00000100:00100000:0.0:1783947355.459634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.459657:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783947355.459663:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236002560:0@lo:400: 00000100:00100000:0.0:1783947355.459686:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.459704:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236003072:0@lo:400: 00000100:00100000:0.0:1783947355.459723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.459747:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236002944:0@lo:400: 00000100:00100000:0.0:1783947355.459894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.459923:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783947355.459929:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236002816:0@lo:400: 00000100:00100000:0.0:1783947355.459956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.459995:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236003328:0@lo:400: 00000100:00100000:0.0:1783947355.460018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947355.460045:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002688 00000100:00100000:0.0:1783947355.460051:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002688 00000100:00100000:0.0:1783947355.460085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002560 00000100:00100000:0.0:1783947355.460088:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002560 00000100:00100000:0.0:1783947355.460099:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003072 00000100:00100000:0.0:1783947355.460100:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003072 00000100:00100000:0.0:1783947355.460145:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002944 00000100:00100000:0.0:1783947355.460149:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002944 00000100:00100000:0.0:1783947355.460164:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947355.460170:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236002688:12345-0@lo:400: 00000100:00100000:0.0:1783947355.460218:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236002688:12345-0@lo:400: Request processed in 47us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.460224:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947355.460238:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947355.460244:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236002560:12345-0@lo:400: 00000100:00100000:0.0:1783947355.460271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236002560:12345-0@lo:400: Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.460277:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1783947355.460284:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc55bb480 x1870604236002432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947355.460288:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947355.460294:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236003072:12345-0@lo:400: 00000100:00100000:1.0:1783947355.460299:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947355.460310:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00100000:0.0:1783947355.460317:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236003072:12345-0@lo:400: Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00080000:1.0:1783947355.460319:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:0.0:1783947355.460323:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1783947355.460324:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783947355.460328:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947355.460332:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783947355.460334:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236002432:0@lo:38: 00000100:00100000:0.0:1783947355.460337:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236002944:12345-0@lo:400: 00000100:00100000:0.0:1783947355.460362:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236002944:12345-0@lo:400: Request processed in 25us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.460375:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947355.460394:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003200 00000100:00100000:0.0:1783947355.460397:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003200 00000100:00100000:0.0:1783947355.460422:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003328 00000100:00100000:0.0:1783947355.460424:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003328 00000100:00100000:0.0:1783947355.460441:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947355.460447:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236003200:12345-0@lo:400: 00000100:00100000:1.0:1783947355.461044:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947355.461055:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236003328:12345-0@lo:400: 00000100:00100000:1.0:1783947355.461100:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236003328:12345-0@lo:400: Request processed in 49us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.461105:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947355.461129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236002816 00000100:00100000:1.0:1783947355.461134:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236002816 00000100:00100000:1.0:1783947355.461201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783947355.461208:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236002816:12345-0@lo:400: 00000100:00100000:1.0:1783947355.461244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236002816:12345-0@lo:400: Request processed in 37us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.461250:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:01000004:2.0:1783947355.461303:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783947355.461325:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e7ac66f4d40) 00000020:00000080:2.0:1783947355.461350:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:3.0:1783947355.461353:0:9524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1870604236003456:0@lo:901: 00000020:01000004:2.0:1783947355.461579:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bc47c2000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783947355.461584:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc47c2000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783947355.461586:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc47c2000 3 00010000:00080000:2.0:1783947355.461623:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac716b000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.103@tcp at head 00000100:00100000:3.0:1783947355.461665:0:9524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.461789:0:9524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac16c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947355.461827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003456 00000100:00100000:1.0:1783947355.461831:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003456 00000100:00100000:1.0:1783947355.461904:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947355.461912:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1870604236003456:12345-0@lo:901: 00000100:00100000:1.0:1783947355.462011:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1870604236003456:12345-0@lo:901: Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.462017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783947355.462077:0:9524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc55bb480 x1870604236003456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783947371 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947355.462101:0:9524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1870604236003456:0@lo:901: 00000100:00100000:1.0:1783947355.463366:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236002816:0@lo:400: 00010000:00080000:1.0:1783947355.463387:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6611880 x1870604236003328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947355.463399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236003328:0@lo:400: 00010000:00080000:1.0:1783947355.463412:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6611f80 x1870604236002944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947355.463421:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236002944:0@lo:400: 00010000:00080000:1.0:1783947355.463488:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6612a00 x1870604236002560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947355.463498:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236002560:0@lo:400: 00010000:00080000:1.0:1783947355.463511:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6612680 x1870604236003072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947355.463519:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236003072:0@lo:400: 00010000:00080000:1.0:1783947355.463545:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6611180 x1870604236002688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947355.463553:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236002688:0@lo:400: 00000100:00080000:1.0:1783947355.463579:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947355.463591:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947355.463593:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947355.466368:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236003200:12345-0@lo:400: Request processed in 5897us (6708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947355.466387:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783947355.466509:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6612300 x1870604236003200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947355.466540:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236003200:0@lo:400: 00010000:00010000:2.0:1783947355.469747:0:9522:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1783947355.470398:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1783947355.470483:0:9522:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783947355.470502:0:9522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe6fd1fdb5550003c 00000100:00080000:2.0:1783947355.470516:0:9522:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947355.470534:0:9522:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e7ac716b000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947355.470583:0:9522:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7147100 x1870604236003584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947355.470606:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783947355.472816:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236003584:0@lo:38: 00000100:00100000:1.0:1783947355.472920:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1783947355.473111:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1783947355.473250:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1783947355.473285:0:9505:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947355.473312:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.473325:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783947355.473390:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783947355.473393:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947355.473394:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947355.473396:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947355.473397:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947355.473398:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947355.473399:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947355.473401:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947355.473402:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947355.473404:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947355.473405:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1783947355.473407:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003584 10000000:01000000:1.0:1783947355.473409:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783947355.473412:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947355.473413:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783947355.473414:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947355.473415:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947355.473416:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1783947355.473417:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003584 00000020:01000004:1.0:1783947355.473417:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947355.473419:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947355.473420:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783947355.473421:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783947355.473422:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947355.473423:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783947355.473449:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783947355.473484:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947355.473493:0:9505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236003712:0@lo:253: 00000100:00100000:2.0:1783947355.473497:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236003584:12345-0@lo:38: 00010000:00080000:2.0:1783947355.473540:0:6510:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1783947355.473580:0:6510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe6fd1fdb55500043 00000004:00100000:2.0:1783947355.473597:0:6510:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783947355.473636:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9e7ac716c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947355.473699:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870604236003584:12345-0@lo:38: Request processed in 201us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947355.473707:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783947355.473758:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7147100 x1870604236003584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947355.473769:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947355.473792:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1783947355.473799:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783947355.473804:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783947355.473807:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac716b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947355.473814:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236003584:0@lo:38: 00000100:00100000:1.0:1783947355.474724:0:9505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.474772:0:9505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947355.474784:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003712 00000100:00100000:2.0:1783947355.474792:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003712 00000100:00100000:2.0:1783947355.474842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783947355.474851:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236003712:12345-0@lo:253: 20000000:01000000:2.0:1783947355.474882:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783947355.474901:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783947355.489147:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783947355.489243:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783947355.489290:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783947355.489296:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783947355.489324:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.489370:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.489378:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.489386:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.489437:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947355.489877:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9505:x1870604236003712:12345-0@lo:253: Request processed in 15023us (15155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.489889:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783947355.490007:0:9505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9505:1870604236003712:0@lo:253: 10000000:01000000:0.0:1783947355.490023:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783947355.490027:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947355.490029:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947355.490030:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947355.490031:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947355.490033:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947355.490034:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947355.490035:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947355.490037:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783947355.490039:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783947355.490041:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947355.490043:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783947355.490063:0:9505:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1783947355.490283:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 16 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.490302:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604236003840:0@lo:104: 00000100:00100000:2.0:1783947355.490345:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947355.490403:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.490412:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.490420:0:6526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604236003968:0@lo:104: 00000100:00100000:1.0:1783947355.490564:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003840 00000100:00100000:1.0:1783947355.490572:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003840 00000100:00100000:1.0:1783947355.490631:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947355.490640:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604236003840:12345-0@lo:104: 00010000:00010000:1.0:1783947355.490657:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947355.490915:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947355.490934:0:6526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947355.490990:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1783947355.490999:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1783947355.491068:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947355.491075:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604236003840:12345-0@lo:104: Request processed in 436us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.491082:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947355.491098:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236003968 00000100:00100000:1.0:1783947355.491101:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236003968 00000100:00100000:1.0:1783947355.491114:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783947355.491119:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604236003968:12345-0@lo:104: 00010000:00010000:1.0:1783947355.491127:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.491159:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947355.491164:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:6526:x1870604236003968:12345-0@lo:104: Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.491182:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947355.491315:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604236003840:0@lo:104: 00000100:00100000:2.0:1783947355.491323:0:6526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1870604236003968:0@lo:104: 00010000:00010000:2.0:1783947355.491355:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.492886:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947355.492903:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.492915:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.492919:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.492930:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.492937:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.492942:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947355.493048:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.493055:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947355.493095:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.493103:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb554fff7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.493121:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947355.493125:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.493149:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947355.493152:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.493158:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947355.493165:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947355.493170:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1783947355.493238:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236004096:0@lo:103: 00000100:00100000:1.0:1783947355.493312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947355.493383:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004096 00000100:00100000:1.0:1783947355.493391:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004096 00010000:00010000:1.0:1783947355.493423:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 17 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947355.493477:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947355.493487:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3640:x1870604236004096:12345-0@lo:103: 00010000:00010000:1.0:1783947355.493502:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947355.493509:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 17 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.493534:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 17 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.493553:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb554fff86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fff7f expref: 17 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947355.493569:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947355.493607:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:3640:x1870604236004096:12345-0@lo:103: Request processed in 122us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947355.493615:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947355.493656:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236004096:0@lo:103: 00010000:00010000:2.0:1783947355.495121:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.495137:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783947355.495213:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236004224:0@lo:103: 00000100:00100000:3.0:1783947355.495285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947355.495369:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004224 00000100:00100000:3.0:1783947355.495377:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004224 00010000:00010000:3.0:1783947355.495411:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.495444:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947355.495453:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:3637:x1870604236004224:12345-0@lo:103: 00010000:00010000:3.0:1783947355.495485:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947355.495490:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495502:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495518:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb554fff40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fff39 expref: 16 pid: 6505 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495547:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495556:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783947355.495595:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006299462s 00010000:00010000:3.0:1783947355.495600:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495607:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495614:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495620:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495627:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ea00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947355.495631:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495639:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495654:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495666:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947355.495713:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3637:x1870604236004224:12345-0@lo:103: Request processed in 260us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947355.495721:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1783947355.495751:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495770:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947355.495915:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb5550004a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947355.495957:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236004224:0@lo:103: 00010000:00010000:2.0:1783947355.496928:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.496939:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb554fff39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fff40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947355.496963:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947355.496965:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947355.496968:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947355.496977:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1783947355.498646:0:9505:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783947355.498901:0:9505:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783947355.499101:0:9505:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783947355.499329:0:9505:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783947355.500060:0:9505:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783947355.500411:0:9505:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1783947355.502595:0:9505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783947355.512573:0:9505:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783947355.512587:0:9505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783947355.512682:0:9505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783947355.512742:0:9505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783947355.512769:0:9505:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1783947355.512860:0:9505:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1783947355.515557:0:9505:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947355.516367:0:9505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1783947356.342500:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947356.403719:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236004352:0@lo:13: 00000100:00100000:0.0:1783947356.403819:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947356.403915:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004352 00000100:00100000:0.0:1783947356.403924:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004352 00000100:00100000:0.0:1783947356.403977:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947356.403986:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236004352:12345-0@lo:13: 00002000:00000024:0.0:1783947356.404023:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947356.404265:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236004480:0@lo:13: 00000100:00100000:3.0:1783947356.404445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947356.404637:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236004352:12345-0@lo:13: Request processed in 651us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947356.404646:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947356.404667:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004480 00000100:00100000:0.0:1783947356.404672:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004480 00000100:00100000:0.0:1783947356.404689:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947356.404694:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236004480:12345-0@lo:13: 00002000:00000024:0.0:1783947356.404709:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947356.404741:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236004480:12345-0@lo:13: Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947356.404747:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783947356.404883:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7500700 x1870604236004480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947356.404904:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236004480:0@lo:13: 00010000:00080000:3.0:1783947356.404942:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc4744a80 x1870604236004352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947356.404954:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236004352:0@lo:13: 00000020:00000004:0.0:1783947356.565536:0:9579:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947356.565831:0:9579:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783947356.916059:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236004608:0@lo:41: 00000100:00100000:3.0:1783947356.916153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947356.918332:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004608 00000100:00100000:0.0:1783947356.918353:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004608 00000100:00100000:0.0:1783947356.918450:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947356.918482:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236004608:12345-0@lo:41: 00000004:00000024:0.0:1783947356.918545:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783947356.918656:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236004608:12345-0@lo:41: Request processed in 177us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947356.918664:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783947356.922579:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236004608:0@lo:41: 00010000:00010000:2.0:1783947357.365144:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947358.393580:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947359.411641:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947359.991043:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947359.991084:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236004736:0@lo:41: 00000100:00100000:0.0:1783947359.991173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947359.991396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004736 00000100:00100000:1.0:1783947359.991406:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004736 00000100:00100000:1.0:1783947359.991503:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783947359.991513:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236004736:12345-0@lo:41: 00000004:00000024:1.0:1783947359.991555:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1783947359.991606:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236004736:12345-0@lo:41: Request processed in 94us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947359.991614:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783947359.991731:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236004736:0@lo:41: 00010000:00010000:2.0:1783947360.436766:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947360.499876:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236005248:0@lo:400: 00000100:00100000:1.0:1783947360.499953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500014:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236005760:0@lo:400: 00000100:00100000:1.0:1783947360.500052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500080:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783947360.500086:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236004864:0@lo:400: 00000100:00100000:1.0:1783947360.500116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500138:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236005376:0@lo:400: 00000100:00100000:1.0:1783947360.500163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500180:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236005888:0@lo:400: 00000100:00100000:1.0:1783947360.500202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500226:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236004992:0@lo:400: 00000100:00100000:1.0:1783947360.500250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500286:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236005504:0@lo:400: 00000100:00100000:1.0:1783947360.500309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500326:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236006016:0@lo:400: 00000100:00100000:1.0:1783947360.500346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500359:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783947360.500365:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236005120:0@lo:400: 00000100:00100000:1.0:1783947360.500385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500396:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236005632:0@lo:400: 00000100:00100000:1.0:1783947360.500415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947360.500496:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236005248 00000100:00100000:1.0:1783947360.500504:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236005248 00000100:00100000:1.0:1783947360.500555:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947360.500564:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236005248:12345-0@lo:400: 00000100:00100000:1.0:1783947360.500624:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236005248:12345-0@lo:400: Request processed in 61us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.500632:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947360.500657:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236005760 00000100:00100000:1.0:1783947360.500661:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236005760 00000100:00100000:1.0:1783947360.500692:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236005632 00000100:00100000:1.0:1783947360.500694:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236005632 00000100:00100000:1.0:1783947360.500714:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947360.500721:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236005760:12345-0@lo:400: 00000100:00100000:1.0:1783947360.500750:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236005760:12345-0@lo:400: Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.500756:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947360.500767:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947360.500772:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236005632:12345-0@lo:400: 00000100:00100000:1.0:1783947360.500814:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236005632:12345-0@lo:400: Request processed in 41us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.500820:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947360.500839:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004864 00000100:00100000:1.0:1783947360.500842:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004864 00000100:00100000:1.0:1783947360.500867:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783947360.500873:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3637:x1870604236004864:12345-0@lo:400: 00000100:00100000:1.0:1783947360.500902:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:3637:x1870604236004864:12345-0@lo:400: Request processed in 30us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.500908:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783947360.500935:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236005376 00000100:00100000:1.0:1783947360.500938:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236005376 00000100:00100000:1.0:1783947360.500958:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236005888 00000100:00100000:1.0:1783947360.500960:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236005888 00000100:00100000:1.0:1783947360.500972:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236004992 00000100:00100000:1.0:1783947360.500975:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236004992 00000100:00100000:1.0:1783947360.500985:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236005504 00000100:00100000:1.0:1783947360.500988:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236005504 00000100:00100000:1.0:1783947360.500999:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006016 00000100:00100000:1.0:1783947360.501001:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006016 00000100:00100000:1.0:1783947360.501012:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236005120 00000100:00100000:1.0:1783947360.501015:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236005120 00000100:00100000:1.0:1783947360.501028:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947360.501033:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236005376:12345-0@lo:400: 00000100:00100000:1.0:1783947360.501064:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236005376:12345-0@lo:400: Request processed in 30us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.501070:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947360.501082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783947360.501088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236005888:12345-0@lo:400: 00000100:00100000:1.0:1783947360.501126:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236005888:12345-0@lo:400: Request processed in 38us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.501133:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783947360.501146:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947360.501152:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236004992:12345-0@lo:400: 00000100:00100000:1.0:1783947360.501181:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236004992:12345-0@lo:400: Request processed in 29us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.501188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947360.501209:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947360.501215:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236005504:12345-0@lo:400: 00000100:00100000:1.0:1783947360.501243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236005504:12345-0@lo:400: Request processed in 28us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.501249:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947360.501262:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947360.501269:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236006016:12345-0@lo:400: 00000100:00100000:1.0:1783947360.501298:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236006016:12345-0@lo:400: Request processed in 30us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.501303:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947360.501314:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947360.501320:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236005120:12345-0@lo:400: 00000100:00100000:1.0:1783947360.501345:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236005120:12345-0@lo:400: Request processed in 26us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947360.501351:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1783947360.501383:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947360.501388:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947360.501390:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783947360.501445:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6408a80 x1870604236005120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501480:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236005120:0@lo:400: 00010000:00080000:1.0:1783947360.501493:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640b800 x1870604236005632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501502:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236005632:0@lo:400: 00010000:00080000:1.0:1783947360.501511:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6409180 x1870604236004992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501519:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236004992:0@lo:400: 00010000:00080000:1.0:1783947360.501529:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6409c00 x1870604236005504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501535:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236005504:0@lo:400: 00010000:00080000:1.0:1783947360.501543:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640b100 x1870604236006016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501549:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236006016:0@lo:400: 00000100:00100000:1.0:1783947360.501586:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236004864:0@lo:400: 00010000:00080000:1.0:1783947360.501596:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640a680 x1870604236005376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501602:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236005376:0@lo:400: 00010000:00080000:1.0:1783947360.501611:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6408700 x1870604236005888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501618:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236005888:0@lo:400: 00000100:00100000:1.0:1783947360.501638:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236005248:0@lo:400: 00010000:00080000:1.0:1783947360.501648:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640ad80 x1870604236005760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947360.501656:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236005760:0@lo:400: 00010000:00010000:1.0:1783947361.460260:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947361.527199:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236006144:0@lo:13: 00000100:00100000:1.0:1783947361.527277:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947361.527526:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006144 00000100:00100000:1.0:1783947361.527536:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006144 00000100:00100000:1.0:1783947361.527646:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947361.527658:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236006144:12345-0@lo:13: 00002000:00000024:1.0:1783947361.527701:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947361.528146:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236006144:12345-0@lo:13: Request processed in 489us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947361.528155:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783947361.528425:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7502d80 x1870604236006144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947361.528449:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236006144:0@lo:13: 00000100:00100000:1.0:1783947361.529454:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236006272:0@lo:13: 00000100:00100000:1.0:1783947361.529539:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947361.529676:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006272 00000100:00100000:0.0:1783947361.529684:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006272 00000100:00100000:1.0:1783947361.529860:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947361.529872:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236006272:12345-0@lo:13: 00002000:00000024:1.0:1783947361.529897:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947361.529955:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236006272:12345-0@lo:13: Request processed in 86us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947361.529962:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783947361.530077:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7144000 x1870604236006272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947361.530166:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236006272:0@lo:13: 00000100:00100000:3.0:1783947362.039899:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236006400:0@lo:41: 00000100:00100000:3.0:1783947362.039975:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947362.040057:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006400 00000100:00100000:3.0:1783947362.040065:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006400 00000100:00100000:3.0:1783947362.040113:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947362.040122:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236006400:12345-0@lo:41: 00000004:00000024:3.0:1783947362.040163:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783947362.040212:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236006400:12345-0@lo:41: Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947362.040219:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947362.040277:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236006400:0@lo:41: 00000001:02000400:1.0:1783947362.143567:0:9869:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783947362.484104:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783947363.059564:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783947363.059574:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bff958800 from 39 10000000:01000000:3.0:1783947363.059580:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783947363.059635:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.059649:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.059662:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947363.059692:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236006528:0@lo:101: 00000100:00100000:3.0:1783947363.059781:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.059857:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.060041:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006528 00000100:00100000:1.0:1783947363.060051:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006528 00000100:00100000:1.0:1783947363.060114:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783947363.060124:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604236006528:12345-0@lo:101: 00010000:00010000:1.0:1783947363.060141:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947363.060170:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500051 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.060198:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.060209:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.060220:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c021c2e00, rc 0) 00000100:00100000:1.0:1783947363.060276:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236006528:12345-0@lo:101: Request processed in 153us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.060283:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783947363.060528:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236006528:0@lo:101: 00010000:00010000:3.0:1783947363.060545:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.060555:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947363.060622:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236006656:0@lo:501: 00000100:00100000:3.0:1783947363.060651:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.060677:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.060788:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006656 00000100:00100000:1.0:1783947363.060793:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006656 00000100:00100000:1.0:1783947363.060822:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783947363.060828:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236006656:12345-0@lo:501: 00000100:00100000:1.0:1783947363.060979:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236006656:12345-0@lo:501: Request processed in 151us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.060986:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783947363.061120:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236006656:0@lo:501: 00000100:00100000:3.0:1783947363.061166:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236006784:0@lo:503: 00000100:00100000:3.0:1783947363.061212:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.061236:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.061336:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006784 00000100:00100000:1.0:1783947363.061340:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006784 00000100:00100000:1.0:1783947363.061374:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783947363.061390:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236006784:12345-0@lo:503: 00000100:00100000:1.0:1783947363.061499:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236006784:12345-0@lo:503: Request processed in 110us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.061506:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783947363.061777:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236006784:0@lo:503: 00000100:00100000:3.0:1783947363.062552:0:9915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9915:1870604236006912:0@lo:502: 00000100:00100000:3.0:1783947363.062609:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.062643:0:9915:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.062946:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236006912 00000100:00100000:1.0:1783947363.062953:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236006912 00000100:00100000:1.0:1783947363.062997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947363.063117:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9915:x1870604236006912:12345-0@lo:502: 00000100:00100000:1.0:1783947363.063350:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9915:x1870604236006912:12345-0@lo:502: Request processed in 235us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.066126:0:9915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9915:1870604236006912:0@lo:502: 00000100:00100000:3.0:1783947363.066232:0:9915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9915:1870604236007040:0@lo:502: 00000100:00100000:3.0:1783947363.066313:0:9915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.066364:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007040 00000100:00100000:3.0:1783947363.066370:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007040 00000100:00100000:1.0:1783947363.069925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783947363.070145:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783947363.070168:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9915:x1870604236007040:12345-0@lo:502: 00000100:00100000:0.0:1783947363.070535:0:9915:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.071005:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:9915:x1870604236007040:12345-0@lo:502: Request processed in 846us (4689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.071014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783947363.073858:0:9915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9915:1870604236007040:0@lo:502: 00000040:00080000:0.0:1783947363.073923:0:9915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1783947363.074169:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1783947363.074205:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947363.074220:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.074233:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947363.074245:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1783947363.074248:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1783947363.074251:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783947363.074298:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.074307:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.074329:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947363.074353:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007168:0@lo:101: 00000100:00100000:3.0:1783947363.074451:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.075008:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.075057:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007168 00000100:00100000:1.0:1783947363.075065:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007168 00000100:00100000:1.0:1783947363.075167:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783947363.075188:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236007168:12345-0@lo:101: 00010000:00010000:1.0:1783947363.075205:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947363.075224:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550005f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.075254:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.075266:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.075275:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c021c2200, rc 0) 00000100:00100000:1.0:1783947363.075385:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236007168:12345-0@lo:101: Request processed in 199us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.075393:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783947363.075857:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007168:0@lo:101: 00010000:00010000:0.0:1783947363.075876:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947363.075888:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947363.075969:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007296:0@lo:501: 00000100:00100000:0.0:1783947363.076009:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.076034:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.076090:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007296 00000100:00100000:3.0:1783947363.076095:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007296 00000100:00100000:3.0:1783947363.076135:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783947363.076143:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236007296:12345-0@lo:501: 00000100:00100000:3.0:1783947363.076316:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236007296:12345-0@lo:501: Request processed in 172us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.076333:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783947363.076368:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007296:0@lo:501: 00000100:00100000:3.0:1783947363.076408:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007424:0@lo:503: 00000100:00100000:3.0:1783947363.076449:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.076489:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.076500:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007424 00000100:00100000:3.0:1783947363.076504:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007424 00000100:00100000:3.0:1783947363.076530:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783947363.076536:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236007424:12345-0@lo:503: 00000100:00100000:3.0:1783947363.077430:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236007424:12345-0@lo:503: Request processed in 887us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.077439:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783947363.077534:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007424:0@lo:503: 00000100:00100000:3.0:1783947363.078035:0:9919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9919:1870604236007552:0@lo:502: 00000100:00100000:3.0:1783947363.078087:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.078118:0:9919:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947363.078483:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007552 00000100:00100000:0.0:1783947363.078490:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007552 00000100:00100000:0.0:1783947363.078539:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783947363.078550:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9919:x1870604236007552:12345-0@lo:502: 00000100:00100000:0.0:1783947363.078842:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9919:x1870604236007552:12345-0@lo:502: Request processed in 294us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.078858:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783947363.079917:0:9919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9919:1870604236007552:0@lo:502: 00000020:01000000:3.0:1783947363.079962:0:9919:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947363.079975:0:9919:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947363.079978:0:9919:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783947363.079983:0:9919:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783947363.079985:0:9919:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783947363.080018:0:9919:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9919:1870604236007680:0@lo:502: 00000100:00100000:3.0:1783947363.080092:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.080135:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007680 00000100:00100000:3.0:1783947363.080140:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007680 00000100:00100000:3.0:1783947363.080313:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783947363.080643:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9919:x1870604236007680:12345-0@lo:502: 00000100:00100000:3.0:1783947363.080778:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:9919:x1870604236007680:12345-0@lo:502: Request processed in 455us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.080785:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783947363.080841:0:9919:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.080855:0:9919:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9919:1870604236007680:0@lo:502: 00000020:01000000:3.0:1783947363.080877:0:9919:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947363.080883:0:9919:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947363.080885:0:9919:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783947363.080889:0:9919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1783947363.080961:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1783947363.080987:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783947363.080999:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.081012:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947363.081023:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783947363.081026:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7be784d800 from 39 10000000:01000000:3.0:1783947363.081028:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783947363.081058:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.081067:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.081086:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947363.081101:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007808:0@lo:101: 00000100:00100000:3.0:1783947363.081130:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.081148:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.081161:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007808 00000100:00100000:3.0:1783947363.081165:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007808 00000100:00100000:3.0:1783947363.082373:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783947363.082401:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236007808:12345-0@lo:101: 00010000:00010000:3.0:1783947363.082420:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947363.082442:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550006d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.082497:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.082510:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.082528:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96400, rc 0) 00000100:00100000:3.0:1783947363.082606:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236007808:12345-0@lo:101: Request processed in 212us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.082613:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783947363.082714:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7503800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007808:0@lo:101: 00010000:00010000:0.0:1783947363.082731:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947363.082741:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947363.083011:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007936:0@lo:501: 00000100:00100000:0.0:1783947363.083048:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.083716:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.084009:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236007936 00000100:00100000:1.0:1783947363.084018:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236007936 00000100:00100000:1.0:1783947363.084063:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783947363.084073:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236007936:12345-0@lo:501: 00000100:00100000:0.0:1783947363.084348:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236007936:0@lo:501: 00000100:00100000:0.0:1783947363.084404:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008064:0@lo:503: 00000100:00100000:0.0:1783947363.084487:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.084505:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.084763:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236007936:12345-0@lo:501: Request processed in 204us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.084774:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783947363.084804:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008064 00000100:00100000:1.0:1783947363.084809:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008064 00000100:00100000:1.0:1783947363.084827:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783947363.084833:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236008064:12345-0@lo:503: 00000100:00100000:1.0:1783947363.084931:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236008064:12345-0@lo:503: Request processed in 97us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.084938:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783947363.085033:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008064:0@lo:503: 00000100:00100000:0.0:1783947363.085741:0:9920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9920:1870604236008192:0@lo:502: 00000100:00100000:0.0:1783947363.085793:0:9920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.085821:0:9920:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.085874:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008192 00000100:00100000:1.0:1783947363.085879:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008192 00000100:00100000:1.0:1783947363.085907:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783947363.085915:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:9920:x1870604236008192:12345-0@lo:502: 00000100:00100000:1.0:1783947363.086105:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:9920:x1870604236008192:12345-0@lo:502: Request processed in 190us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.086113:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783947363.086255:0:9920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9920:1870604236008192:0@lo:502: 00000100:00100000:0.0:1783947363.086306:0:9920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9920:1870604236008320:0@lo:502: 00000100:00100000:0.0:1783947363.086432:0:9920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.086653:0:9920:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.086693:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008320 00000100:00100000:1.0:1783947363.086698:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008320 00000100:00100000:1.0:1783947363.086735:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783947363.086744:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:9920:x1870604236008320:12345-0@lo:502: 00000100:00100000:1.0:1783947363.086879:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:9920:x1870604236008320:12345-0@lo:502: Request processed in 136us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.086897:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783947363.087165:0:9920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9920:1870604236008320:0@lo:502: 00000040:00080000:0.0:1783947363.087276:0:9920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1783947363.087666:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1783947363.087694:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947363.087706:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.087718:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947363.087729:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947363.087732:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7be784d800 from 6 10000000:01000000:1.0:1783947363.087735:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947363.087771:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.087780:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.087791:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.087809:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008448:0@lo:101: 00000100:00100000:1.0:1783947363.087870:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.087902:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.087922:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008448 00000100:00100000:1.0:1783947363.087927:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008448 00000100:00100000:1.0:1783947363.087965:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783947363.087974:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236008448:12345-0@lo:101: 00010000:00010000:1.0:1783947363.087987:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947363.088010:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c021c2400/0xe6fd1fdb55500082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550007b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.088049:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c021c2400/0xe6fd1fdb55500082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550007b expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.088061:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c021c2400/0xe6fd1fdb55500082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550007b expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.088071:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c021c2400, rc 0) 00000100:00100000:1.0:1783947363.088103:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236008448:12345-0@lo:101: Request processed in 130us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.088110:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783947363.088148:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008448:0@lo:101: 00010000:00010000:1.0:1783947363.088164:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.088173:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.088312:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008576:0@lo:256: 00000100:00100000:1.0:1783947363.088441:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.088480:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.088496:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008576 00000100:00100000:1.0:1783947363.088500:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008576 00000100:00100000:1.0:1783947363.088538:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783947363.088545:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236008576:12345-0@lo:256: 20000000:01000000:1.0:1783947363.088637:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947363.088661:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947363.088670:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783947363.088774:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236008576:12345-0@lo:256: Request processed in 229us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.088781:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783947363.088814:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008576:0@lo:256: 10000000:01000000:1.0:1783947363.088862:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947363.088869:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.088879:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947363.088886:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783947363.088889:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1783947363.088892:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783947363.088912:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.088920:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.088928:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.088941:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008704:0@lo:101: 00000100:00100000:1.0:1783947363.088969:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.088982:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.088994:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008704 00000100:00100000:1.0:1783947363.088997:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008704 00000100:00100000:1.0:1783947363.089017:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783947363.089030:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236008704:12345-0@lo:101: 00010000:00010000:1.0:1783947363.089038:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947363.089048:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500089 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.089065:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.089073:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.089081:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c021c3a00, rc 0) 00000100:00100000:1.0:1783947363.089108:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236008704:12345-0@lo:101: Request processed in 78us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.089114:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783947363.089139:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008704:0@lo:101: 00010000:00010000:1.0:1783947363.089149:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.089156:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.089446:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008832:0@lo:501: 00000100:00100000:1.0:1783947363.089505:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.089530:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.089543:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008832 00000100:00100000:1.0:1783947363.089547:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008832 00000100:00100000:1.0:1783947363.089636:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783947363.089643:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236008832:12345-0@lo:501: 00000100:00100000:1.0:1783947363.089794:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236008832:12345-0@lo:501: Request processed in 152us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.089801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783947363.089832:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008832:0@lo:501: 00000100:00100000:1.0:1783947363.089864:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008960:0@lo:503: 00000100:00100000:1.0:1783947363.089908:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.089922:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.089934:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236008960 00000100:00100000:1.0:1783947363.089937:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236008960 00000100:00100000:1.0:1783947363.089955:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783947363.089961:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236008960:12345-0@lo:503: 00000100:00100000:1.0:1783947363.090040:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236008960:12345-0@lo:503: Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.090046:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783947363.090082:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236008960:0@lo:503: 00000100:00100000:0.0:1783947363.091153:0:9922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9922:1870604236009088:0@lo:502: 00000100:00100000:0.0:1783947363.091296:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.091452:0:9922:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.091741:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009088 00000100:00100000:1.0:1783947363.091749:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009088 00000100:00100000:1.0:1783947363.091833:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783947363.091844:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:9922:x1870604236009088:12345-0@lo:502: 00000100:00100000:1.0:1783947363.091991:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:9922:x1870604236009088:12345-0@lo:502: Request processed in 148us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.091998:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783947363.092076:0:9922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9922:1870604236009088:0@lo:502: 00000020:01000000:0.0:1783947363.092106:0:9922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947363.092114:0:9922:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783947363.092121:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947363.092124:0:9922:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783947363.092130:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783947363.092134:0:9922:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:0.0:1783947363.092164:0:9922:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783947363.092168:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947363.092199:0:9922:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e7c01b8b380) 00000020:00000080:0.0:1783947363.092230:0:9922:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1783947363.092236:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783947363.092370:0:9922:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1783947363.092388:0:9922:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783947363.092398:0:9922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb5550009e 00010000:00080000:0.0:1783947363.092435:0:9922:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7be794e000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1783947363.092910:0:9922:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1783947363.093084:0:9922:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1783947363.093099:0:9922:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1783947363.093311:0:9922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947363.094144:0:9922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947363.095435:0:9922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1783947363.095771:0:9922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783947363.098906:0:9923:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947363.098918:0:9923:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783947363.102308:0:9922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783947363.102414:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783947363.102536:0:9922:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783947363.102639:0:9922:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb555000a5 00000100:00080000:0.0:1783947363.102653:0:9922:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947363.102660:0:9922:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7be794e000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947363.102708:0:9922:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d69880 x1870604236009216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947363.102736:0:9922:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1783947363.102916:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236009344:0@lo:400: 00000100:00100000:0.0:1783947363.103001:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.103037:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236009856:0@lo:400: 00000100:00100000:0.0:1783947363.103060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.103078:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236010368:0@lo:400: 00000100:00100000:0.0:1783947363.103101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.103123:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783947363.103129:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236009472:0@lo:400: 00000100:00100000:0.0:1783947363.103155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.103174:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236009984:0@lo:400: 00000100:00100000:1.0:1783947363.103443:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236009216:0@lo:8: 00000100:00100000:1.0:1783947363.103506:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.104271:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009216 00000100:00100000:1.0:1783947363.104291:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009216 00000100:00100000:1.0:1783947363.104428:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947363.104437:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236009216:12345-0@lo:8: 00010000:00080000:1.0:1783947363.104513:0:8426:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1783947363.104630:0:8426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb555000ac 00002000:00100000:1.0:1783947363.104648:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e7c01bf6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1783947363.104653:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1783947363.104659:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1783947363.104752:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783947363.105026:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1783947363.105063:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947363.105156:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604236009216:12345-0@lo:8: Request processed in 717us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.105165:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947363.106436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.106504:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236010496:0@lo:400: 00000100:00100000:0.0:1783947363.106540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.106720:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236009600:0@lo:400: 00000100:00100000:0.0:1783947363.106752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.106765:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236010112:0@lo:400: 00000100:00100000:0.0:1783947363.106791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.106819:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783947363.106827:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236009728:0@lo:400: 00000100:00100000:0.0:1783947363.106870:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.106894:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236010240:0@lo:400: 00000100:00100000:0.0:1783947363.106916:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.106954:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009344 00000100:00100000:0.0:1783947363.106963:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009344 00000100:00100000:0.0:1783947363.107007:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009856 00000100:00100000:0.0:1783947363.107010:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009856 00000100:00100000:0.0:1783947363.107035:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236010368 00000100:00100000:0.0:1783947363.107038:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236010368 00000100:00100000:0.0:1783947363.107051:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009984 00000100:00100000:0.0:1783947363.107054:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009984 00000100:00100000:0.0:1783947363.107066:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236010496 00000100:00100000:0.0:1783947363.107069:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236010496 00000100:00100000:0.0:1783947363.107080:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009600 00000100:00100000:0.0:1783947363.107082:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009600 00000100:00100000:0.0:1783947363.107098:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947363.107106:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236009344:12345-0@lo:400: 00000100:00100000:0.0:1783947363.107166:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236009344:12345-0@lo:400: Request processed in 60us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.107174:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783947363.108427:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236010112 00000100:00100000:1.0:1783947363.108440:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236010112 00000100:00100000:1.0:1783947363.108496:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236010240 00000100:00100000:1.0:1783947363.108500:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236010240 00000100:00100000:1.0:1783947363.108518:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947363.108527:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236010112:12345-0@lo:400: 00000100:00100000:1.0:1783947363.108823:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236010112:12345-0@lo:400: Request processed in 296us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.108830:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947363.108848:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947363.108854:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236010240:12345-0@lo:400: 00000100:00100000:1.0:1783947363.108885:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236010240:12345-0@lo:400: Request processed in 31us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.108902:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947363.108952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947363.108960:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236009856:12345-0@lo:400: 00010000:00080000:2.0:1783947363.109938:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0700 x1870604236010240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947363.109968:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236010240:0@lo:400: 00010000:00080000:2.0:1783947363.109987:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e3480 x1870604236010112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947363.109995:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236010112:0@lo:400: 00000100:00100000:0.0:1783947363.110047:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783947363.110066:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236010368:12345-0@lo:400: 00000100:00100000:0.0:1783947363.110130:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236010368:12345-0@lo:400: Request processed in 69us (7026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.110137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783947363.110154:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947363.110161:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236009984:12345-0@lo:400: 00000100:00100000:1.0:1783947363.110269:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236009856:12345-0@lo:400: Request processed in 38us (5935us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.110279:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947363.110295:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947363.110304:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236010496:12345-0@lo:400: 00000100:00100000:1.0:1783947363.110415:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236010496:12345-0@lo:400: Request processed in 112us (3873us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.110421:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947363.110433:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783947363.110440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236009600:12345-0@lo:400: 00000100:00100000:1.0:1783947363.110500:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236009600:12345-0@lo:400: Request processed in 61us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.110506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783947363.110535:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947363.110541:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947363.110543:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947363.110841:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236009984:12345-0@lo:400: Request processed in 680us (4413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.110857:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947363.110894:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009472 00000100:00100000:0.0:1783947363.110901:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009472 00000100:00100000:0.0:1783947363.110949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236009728 00000100:00100000:0.0:1783947363.110952:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236009728 00000100:00100000:0.0:1783947363.110966:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783947363.110973:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236009472:12345-0@lo:400: 00000100:00100000:0.0:1783947363.111013:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236009472:12345-0@lo:400: Request processed in 41us (7857us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.111019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783947363.111030:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783947363.111036:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236009728:12345-0@lo:400: 00000100:00100000:0.0:1783947363.111064:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236009728:12345-0@lo:400: Request processed in 28us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.111069:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783947363.111135:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236009472:0@lo:400: 00010000:00080000:0.0:1783947363.111149:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e3b80 x1870604236009984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.111159:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236009984:0@lo:400: 00010000:00080000:0.0:1783947363.111171:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2d80 x1870604236010496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783947363.111275:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d69880 x1870604236009216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947363.111285:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947363.111296:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783947363.111306:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783947363.111312:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783947363.111317:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be794e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783947363.111414:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783947363.111421:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236009216:0@lo:8: 00000100:00100000:2.0:1783947363.111680:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236009728:0@lo:400: 00010000:00080000:2.0:1783947363.111696:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d6b480 x1870604236009600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947363.111705:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236009600:0@lo:400: 00000020:01000000:1.0:1783947363.112452:0:9922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947363.112485:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947363.112488:0:9922:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783947363.112495:0:9922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947363.112501:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947363.112503:0:9922:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783947363.112506:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783947363.112508:0:9922:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783947363.112715:0:9925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236010752:0@lo:700: 00000100:00100000:3.0:1783947363.112791:0:9925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.112827:0:9925:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.112852:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236010752 00000100:00100000:3.0:1783947363.112857:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236010752 00000100:00100000:3.0:1783947363.112918:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947363.112927:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9925:x1870604236010752:12345-0@lo:700: 00000100:00100000:3.0:1783947363.112963:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1870604236010880:0@lo:700: 00000100:00100000:3.0:1783947363.112991:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.113010:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c9c0 going to sleep for 11 seconds 00000004:00080000:3.0:1783947363.113031:0:9923:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783947363.113127:0:9923:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 248340669352ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783947363.113134:0:9923:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783947363.113286:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236010496:0@lo:400: 00010000:00080000:0.0:1783947363.113316:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d68000 x1870604236009344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.113404:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236009344:0@lo:400: 00010000:00080000:0.0:1783947363.113432:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e3100 x1870604236009856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.113441:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236009856:0@lo:400: 00010000:00080000:0.0:1783947363.113452:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0000 x1870604236010368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.113486:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236010368:0@lo:400: 00000100:00100000:0.0:1783947363.113527:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236010880 00000100:00100000:0.0:1783947363.113531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236010880 00000100:00100000:1.0:1783947363.113659:0:9922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9922:1870604236010624:0@lo:502: 00000100:00080000:1.0:1783947363.113675:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947363.113739:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.113766:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236010624 00000100:00100000:1.0:1783947363.113769:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236010624 00000100:00100000:1.0:1783947363.113803:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783947363.113810:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:9922:x1870604236010624:12345-0@lo:502: 00000100:00100000:1.0:1783947363.113929:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:9922:x1870604236010624:12345-0@lo:502: Request processed in 119us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.113937:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783947363.113994:0:9922:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.114006:0:9922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9922:1870604236010624:0@lo:502: 00000020:01000000:1.0:1783947363.114030:0:9922:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947363.114036:0:9922:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947363.114038:0:9922:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783947363.114044:0:9922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1783947363.114116:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1783947363.114144:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783947363.114155:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.114173:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947363.114314:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947363.115297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1870604236010880:12345-0@lo:700: 10000000:01000000:1.0:1783947363.115710:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783947363.115714:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc9511800 from 39 10000000:01000000:1.0:1783947363.115718:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947363.115761:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.115771:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.115782:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.115804:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011008:0@lo:101: 00000100:00100000:1.0:1783947363.115868:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.115914:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.116146:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011008 00000100:00100000:3.0:1783947363.116153:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011008 00000100:00100000:3.0:1783947363.116425:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783947363.116436:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236011008:12345-0@lo:101: 00010000:00010000:3.0:1783947363.116449:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947363.116503:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555000b3 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.117281:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.117297:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947363.117307:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97000, rc 0) 00000100:00100000:3.0:1783947363.117500:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236011008:12345-0@lo:101: Request processed in 1065us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.117634:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783947363.117777:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011008:0@lo:101: 00010000:00010000:0.0:1783947363.117799:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947363.117810:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947363.117899:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011136:0@lo:501: 00000100:00100000:0.0:1783947363.117936:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.117974:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c949c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.118031:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011136 00000100:00100000:3.0:1783947363.118037:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011136 00000100:00100000:3.0:1783947363.118082:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783947363.118090:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236011136:12345-0@lo:501: 00000100:00100000:3.0:1783947363.119542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236011136:12345-0@lo:501: Request processed in 1433us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.119549:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011136:0@lo:501: 00000100:00100000:0.0:1783947363.119604:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011264:0@lo:503: 00000100:00100000:3.0:1783947363.119627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783947363.119728:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.119764:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.119914:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011264 00000100:00100000:1.0:1783947363.119922:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011264 00000100:00100000:1.0:1783947363.119968:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783947363.119977:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236011264:12345-0@lo:503: 00000100:00100000:1.0:1783947363.120103:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236011264:12345-0@lo:503: Request processed in 126us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.120110:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783947363.120156:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011264:0@lo:503: 00000004:00080000:3.0:1783947363.126151:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:0.0:1783947363.126241:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1783947363.127651:0:9927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9927:1870604236011392:0@lo:502: 00000100:00100000:1.0:1783947363.127761:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.127807:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011392 00000100:00100000:1.0:1783947363.127815:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011392 00000100:00100000:1.0:1783947363.127867:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783947363.127875:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:9927:x1870604236011392:12345-0@lo:502: 00000100:00100000:1.0:1783947363.128184:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:9927:x1870604236011392:12345-0@lo:502: Request processed in 308us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.128194:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783947363.128587:0:9927:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0188d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.128617:0:9927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9927:1870604236011392:0@lo:502: 00000100:00100000:1.0:1783947363.128692:0:9927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9927:1870604236011520:0@lo:502: 00000100:00100000:1.0:1783947363.128730:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.128756:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011520 00000100:00100000:1.0:1783947363.128760:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011520 00000100:00100000:1.0:1783947363.128789:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783947363.128796:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:9927:x1870604236011520:12345-0@lo:502: 00000100:00100000:1.0:1783947363.128866:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:9927:x1870604236011520:12345-0@lo:502: Request processed in 70us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.128873:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783947363.128903:0:9927:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.128914:0:9927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9927:1870604236011520:0@lo:502: 00000040:00080000:1.0:1783947363.129059:0:9927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1783947363.132209:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1783947363.132276:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947363.132292:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.132320:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947363.132331:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947363.132334:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bc9511800 from 6 10000000:01000000:1.0:1783947363.132337:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947363.132390:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.132406:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.132419:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.132446:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011648:0@lo:101: 00000100:00100000:1.0:1783947363.132712:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.132759:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.132785:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011648 00000100:00100000:1.0:1783947363.132793:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011648 00000100:00100000:1.0:1783947363.132846:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783947363.132856:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236011648:12345-0@lo:101: 00010000:00010000:1.0:1783947363.132872:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947363.132887:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c021c3600/0xe6fd1fdb555000c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555000c1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.132915:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c021c3600/0xe6fd1fdb555000c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555000c1 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.132937:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c021c3600/0xe6fd1fdb555000c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555000c1 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.132947:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c021c3600, rc 0) 00000100:00100000:1.0:1783947363.132988:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236011648:12345-0@lo:101: Request processed in 133us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.132996:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783947363.133050:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011648:0@lo:101: 00010000:00010000:1.0:1783947363.133066:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.133075:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.133123:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011776:0@lo:256: 00000100:00100000:1.0:1783947363.133154:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.133168:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.133182:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011776 00000100:00100000:1.0:1783947363.133185:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011776 00000100:00100000:1.0:1783947363.133209:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783947363.133215:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236011776:12345-0@lo:256: 20000000:01000000:1.0:1783947363.133229:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783947363.133615:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783947363.133620:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783947363.133727:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236011776:12345-0@lo:256: Request processed in 511us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.133734:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783947363.133780:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011776:0@lo:256: 10000000:01000000:1.0:1783947363.133833:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947363.133840:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.133848:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947363.133856:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783947363.133859:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783947363.133861:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783947363.133884:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.133891:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.133899:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.133911:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011904:0@lo:101: 00000100:00100000:1.0:1783947363.133956:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.133971:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.133983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236011904 00000100:00100000:1.0:1783947363.133987:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236011904 00000100:00100000:1.0:1783947363.134011:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783947363.134018:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236011904:12345-0@lo:101: 00010000:00010000:1.0:1783947363.134028:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947363.134040:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555000cf expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.134065:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.134074:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.134082:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c02053600, rc 0) 00000100:00100000:1.0:1783947363.134107:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236011904:12345-0@lo:101: Request processed in 90us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.134112:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783947363.134140:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236011904:0@lo:101: 00010000:00010000:1.0:1783947363.134152:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.134159:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.134215:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012032:0@lo:501: 00000100:00100000:1.0:1783947363.134684:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.134713:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83240 going to sleep for 11 seconds 00000020:00000004:2.0:1783947363.134727:0:9928:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1783947363.134743:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012032 00000100:00100000:1.0:1783947363.134747:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012032 00000100:00100000:1.0:1783947363.134775:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783947363.134782:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236012032:12345-0@lo:501: 00000020:00000004:2.0:1783947363.135023:0:9928:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783947363.135053:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236012032:12345-0@lo:501: Request processed in 271us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.135061:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783947363.135106:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012032:0@lo:501: 00000100:00100000:1.0:1783947363.135139:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012160:0@lo:503: 00000100:00100000:1.0:1783947363.135180:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.135193:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.135206:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012160 00000100:00100000:1.0:1783947363.135209:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012160 00000100:00100000:1.0:1783947363.135231:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783947363.135319:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236012160:12345-0@lo:503: 00000100:00100000:1.0:1783947363.135769:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236012160:12345-0@lo:503: Request processed in 529us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.135777:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783947363.135821:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012160:0@lo:503: 00000100:00100000:2.0:1783947363.136919:0:9930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9930:1870604236012288:0@lo:502: 00000100:00100000:3.0:1783947363.137745:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.137837:0:9930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa88f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.137880:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012288 00000100:00100000:1.0:1783947363.137888:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012288 00000100:00100000:1.0:1783947363.137940:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783947363.137950:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:9930:x1870604236012288:12345-0@lo:502: 00000100:00100000:1.0:1783947363.138136:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:9930:x1870604236012288:12345-0@lo:502: Request processed in 187us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.138144:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783947363.138303:0:9930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9930:1870604236012288:0@lo:502: 00000020:01000000:3.0:1783947363.138847:0:9930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783947363.138857:0:9930:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783947363.138892:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947363.138895:0:9930:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783947363.138901:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783947363.138905:0:9930:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:3.0:1783947363.138932:0:9930:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783947363.138936:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947363.138967:0:9930:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e7ac779b380) 00000020:00000080:3.0:1783947363.138998:0:9930:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1783947363.139005:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783947363.139107:0:9930:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783947363.139113:0:9930:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1783947363.139119:0:9930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb555000e4 00010000:00080000:3.0:1783947363.139159:0:9930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac73cd800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947363.139847:0:9930:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000100:00100000:1.0:1783947363.139985:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1870604236010880:12345-0@lo:700: Request processed in 24701us (26989us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.140002:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783947363.140056:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7502a00 x1870604236010880/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947363.140070:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1870604236010880:0@lo:700: 40000000:02000000:1.0:1783947363.140089:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:01000000:0.0:1783947363.147347:0:9930:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1783947363.147370:0:9930:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783947363.147628:0:9930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947363.149358:0:9930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947363.149565:0:9930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1783947363.149662:0:9930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1783947363.153744:0:9931:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947363.153753:0:9931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:0.0:1783947363.159970:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783947363.160535:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9925:x1870604236010752:12345-0@lo:700: Request processed in 47505us (47640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.160561:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783947363.163814:0:9925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7500e00 x1870604236010752/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.163840:0:9925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236010752:0@lo:700: 00000020:00000080:2.0:1783947363.164984:0:9930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947363.165065:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783947363.165133:0:9930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783947363.165168:0:9930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb555000eb 00000100:00080000:2.0:1783947363.165246:0:9930:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783947363.165253:0:9930:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7ac73cd800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947363.165297:0:9930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7144380 x1870604236012416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947363.165667:0:9930:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1783947363.165736:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236012416:0@lo:8: 00000020:01000000:2.0:1783947363.165804:0:9930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947363.165810:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947363.165826:0:9930:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783947363.165832:0:9930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1783947363.165832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1783947363.165838:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947363.165841:0:9930:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947363.165845:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947363.165847:0:9930:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783947363.165879:0:9930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7145500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9930:1870604236012544:0@lo:502: 00000100:00100000:2.0:1783947363.165935:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947363.165962:0:9930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa88b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947363.166022:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012544 00000100:00100000:0.0:1783947363.166032:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012544 00000100:00100000:1.0:1783947363.166041:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012416 00000100:00100000:1.0:1783947363.166048:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012416 00000100:00100000:0.0:1783947363.166087:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783947363.166092:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947363.166099:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:9930:x1870604236012544:12345-0@lo:502: 00000100:00100000:1.0:1783947363.166102:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236012416:12345-0@lo:8: 00010000:00080000:1.0:1783947363.166133:0:8426:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1783947363.166166:0:8426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb555000f2 00000100:00100000:0.0:1783947363.166260:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:9930:x1870604236012544:12345-0@lo:502: Request processed in 164us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.166269:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783947363.166360:0:9930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7145500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:9930:1870604236012544:0@lo:502: 00000020:01000000:2.0:1783947363.166395:0:9930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947363.166400:0:9930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947363.166402:0:9930:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783947363.166406:0:9930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1783947363.166518:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1783947363.166545:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783947363.166556:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947363.166567:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947363.166589:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783947363.166592:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e7bc5510000 from 1 10000000:01000000:0.0:1783947363.166594:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783947363.166622:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947363.166705:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947363.166717:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947363.166731:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012672:0@lo:101: 00000100:00100000:0.0:1783947363.166764:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.166785:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94180 going to sleep for 11 seconds 00002000:00100000:1.0:1783947363.166884:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e7c01bf2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783947363.166891:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783947363.166893:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783947363.167000:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783947363.167042:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947363.167096:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604236012416:12345-0@lo:8: Request processed in 995us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.167105:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947363.167130:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012672 00000100:00100000:1.0:1783947363.167135:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012672 00000100:00100000:1.0:1783947363.167166:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783947363.167173:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236012672:12345-0@lo:101: 00010000:00010000:1.0:1783947363.167306:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947363.167407:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555000f9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.167644:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.167658:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.167677:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c02052e00, rc 0) 00000100:00100000:1.0:1783947363.167721:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236012672:12345-0@lo:101: Request processed in 548us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.167727:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783947363.167777:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012672:0@lo:101: 00010000:00010000:1.0:1783947363.167793:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947363.167804:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947363.167874:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012800:0@lo:501: 00000100:00100000:1.0:1783947363.167905:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.167927:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.167942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012800 00000100:00100000:1.0:1783947363.167946:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012800 00000100:00100000:1.0:1783947363.167973:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783947363.167979:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236012800:12345-0@lo:501: 00000100:00100000:1.0:1783947363.168330:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236012800:12345-0@lo:501: Request processed in 341us (415us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947363.168338:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:1.0:1783947363.168432:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7144380 x1870604236012416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947363.168444:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783947363.168453:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783947363.168493:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783947363.168499:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783947363.168513:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73cd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783947363.168639:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783947363.168648:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236012416:0@lo:8: 00000100:00100000:3.0:1783947363.172771:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947363.172806:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236012928:0@lo:13: 00000100:00100000:3.0:1783947363.172922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.172980:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236012928 00000100:00100000:3.0:1783947363.172989:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236012928 00000100:00100000:3.0:1783947363.173070:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947363.173080:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236012928:12345-0@lo:13: 00002000:00000024:3.0:1783947363.173116:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1783947363.173168:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236012928:12345-0@lo:13: Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.174726:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947363.175156:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236012800:0@lo:501: 00010000:00080000:3.0:1783947363.175676:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7500a80 x1870604236012928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947363.175702:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236012928:0@lo:13: 00000004:00080000:3.0:1783947363.175728:0:9932:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783947363.175770:0:9932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013056:0@lo:7: 00000100:00100000:3.0:1783947363.175842:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947363.175890:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013056 00000100:00100000:3.0:1783947363.175898:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013056 00000100:00100000:3.0:1783947363.175951:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947363.175962:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9932:x1870604236013056:12345-0@lo:7: 10000000:01000000:2.0:1783947363.176691:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783947363.176707:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947363.176719:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783947363.177963:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1783947363.178773:0:9931:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783947363.178939:0:9931:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 248406481812ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783947363.178950:0:9931:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1783947363.182580:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783947363.183997:0:9932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c300 going to sleep for 11 seconds 00000004:00080000:0.0:1783947363.190830:0:9925:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783947363.190872:0:9925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236013312:0@lo:7: 00000100:00100000:0.0:1783947363.190958:0:9925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.191006:0:9925:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94600 going to sleep for 11 seconds 00002000:00080000:3.0:1783947363.191146:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783947363.191155:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783947363.191229:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9932:x1870604236013056:12345-0@lo:7: Request processed in 15267us (15384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.191252:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947363.191283:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013312 00000100:00100000:3.0:1783947363.191291:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013312 00010000:00080000:0.0:1783947363.191437:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7500a80 x1870604236013056/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.191452:0:9932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013056:0@lo:7: 00000004:00080000:0.0:1783947363.191487:0:9932:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783947363.191498:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947363.191514:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236013184:0@lo:13: 00000100:00100000:0.0:1783947363.191520:0:9932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013440:0@lo:5: 00000100:00100000:0.0:1783947363.191548:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.191572:0:9932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947363.191621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947363.191663:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013440 00000100:00100000:2.0:1783947363.191667:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013440 00000100:00100000:2.0:1783947363.191701:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947363.191709:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9932:x1870604236013440:12345-0@lo:5: 00000100:00100000:0.0:1783947363.191726:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013184 00000100:00100000:0.0:1783947363.191732:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013184 00002000:00080000:2.0:1783947363.191747:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783947363.191753:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783947363.191764:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783947363.191773:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1870604236013184:12345-0@lo:13: 00002000:00000024:0.0:1783947363.191790:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1783947363.191835:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1870604236013184:12345-0@lo:13: Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947363.191845:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947363.192118:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947363.192127:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9925:x1870604236013312:12345-0@lo:7: 00010000:00080000:2.0:1783947363.193629:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e3b80 x1870604236013184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947363.193660:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236013184:0@lo:13: 00000001:00080000:1.0:1783947363.202431:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1783947363.202471:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783947363.203995:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9932:x1870604236013440:12345-0@lo:5: Request processed in 12274us (12434us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783947363.204023:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783947363.204108:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2d80 x1870604236013440/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947363.204121:0:9932:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783947363.204128:0:9932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013440:0@lo:5: 00000004:00080000:2.0:1783947363.204146:0:9932:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783947363.204205:0:9932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013568:0@lo:700: 00000100:00100000:2.0:1783947363.204242:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947363.204272:0:9932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa88540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947363.208583:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013568 00000100:00100000:3.0:1783947363.208602:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013568 00000100:00100000:3.0:1783947363.208682:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947363.208694:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9932:x1870604236013568:12345-0@lo:700: 00000100:00100000:3.0:1783947363.215288:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9932:x1870604236013568:12345-0@lo:700: Request processed in 6587us (11035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947363.215307:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783947363.215523:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7147800 x1870604236013568/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.215541:0:9932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013568:0@lo:700: 00002000:00080000:1.0:1783947363.218851:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1783947363.218862:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783947363.218980:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9925:x1870604236013312:12345-0@lo:7: Request processed in 26848us (28017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.218992:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1783947363.220344:0:9925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2300 x1870604236013312/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.220365:0:9925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236013312:0@lo:7: 00000004:00080000:0.0:1783947363.220392:0:9925:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783947363.220444:0:9925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236013696:0@lo:5: 00000100:00100000:0.0:1783947363.220533:0:9925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.220582:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013696 00000100:00100000:0.0:1783947363.220583:0:9925:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.220591:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013696 00000100:00100000:1.0:1783947363.220651:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947363.220662:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9925:x1870604236013696:12345-0@lo:5: 00002000:00080000:1.0:1783947363.220693:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1783947363.220742:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9925:x1870604236013696:12345-0@lo:5: Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.220750:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:02000040:1.0:1783947363.220783:0:9932:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00010000:00080000:0.0:1783947363.223260:0:9925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2300 x1870604236013696/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947363.223282:0:9925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236013696:0@lo:5: 00000004:00080000:0.0:1783947363.223299:0:9925:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1783947363.223360:0:9925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236013824:0@lo:5: 00000100:00100000:0.0:1783947363.223439:0:9925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947363.223537:0:9925:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.224092:0:9932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013952:0@lo:5: 00000100:00100000:1.0:1783947363.224135:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947363.224166:0:9932:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947363.224304:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013824 00000100:00100000:2.0:1783947363.224313:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013824 00000100:00100000:2.0:1783947363.224394:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236013952 00000100:00100000:2.0:1783947363.224398:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236013952 00000100:00100000:2.0:1783947363.224426:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947363.224434:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9925:x1870604236013824:12345-0@lo:5: 00002000:00080000:2.0:1783947363.224506:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1783947363.225335:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947363.225351:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9932:x1870604236013952:12345-0@lo:5: 00000100:00100000:2.0:1783947363.227438:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9925:x1870604236013824:12345-0@lo:5: Request processed in 2994us (3989us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783947363.227479:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783947363.227640:0:9925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2300 x1870604236013824/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947363.227660:0:9925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9925:1870604236013824:0@lo:5: 00000004:00080000:2.0:1783947363.227676:0:9925:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1783947363.227727:0:9925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7145c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9925:1870604236014080:0@lo:900: 00000100:00100000:2.0:1783947363.227770:0:9925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947363.227797:0:9925:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bffa886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947363.229052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014080 00000100:00100000:1.0:1783947363.229065:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014080 00000100:00100000:1.0:1783947363.229123:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947363.229134:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9925:x1870604236014080:12345-0@lo:900: 00000100:00100000:1.0:1783947363.229229:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9925:x1870604236014080:12345-0@lo:900: Request processed in 97us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947363.229237:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783947363.229328:0:9925:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7145c00 x1870604236014080/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947363.229344:0:9925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7145c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9925:1870604236014080:0@lo:900: 00002000:00080000:1.0:1783947363.243327:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1783947363.243353:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1783947363.245434:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9932:x1870604236013952:12345-0@lo:5: Request processed in 20080us (21288us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783947363.245450:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783947363.245546:0:9932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ce8a80 x1870604236013952/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947379 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947363.245567:0:9932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9932:1870604236013952:0@lo:5: 00000004:00080000:1.0:1783947363.245586:0:9932:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1783947363.511860:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783947364.080352:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1783947364.080382:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1783947364.535510:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947365.107913:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236014208:0@lo:41: 00000100:00100000:2.0:1783947365.107988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947365.109385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014208 00000100:00100000:1.0:1783947365.109400:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014208 00000100:00100000:1.0:1783947365.109478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947365.109488:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236014208:12345-0@lo:41: 00000004:00000024:1.0:1783947365.109531:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783947365.109600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236014208:12345-0@lo:41: Request processed in 114us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947365.109607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783947365.110105:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236014208:0@lo:41: 00010000:00010000:1.0:1783947365.556719:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783947365.848736:0:10032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947365.856868:0:10032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783947366.580578:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947366.645410:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236014336:0@lo:13: 00000100:00100000:2.0:1783947366.645506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947366.645595:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014336 00000100:00100000:2.0:1783947366.645604:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014336 00000100:00100000:2.0:1783947366.645668:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947366.645678:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236014336:12345-0@lo:13: 00002000:00000024:2.0:1783947366.645714:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947366.645760:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236014336:12345-0@lo:13: Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947366.645779:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1783947366.645801:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947366.645837:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7145180 x1870604236014336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947366.645856:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236014336:0@lo:13: 00000100:00100000:0.0:1783947366.648047:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947366.648070:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236014464:0@lo:13: 00000100:00100000:0.0:1783947366.648134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947366.648235:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014464 00000100:00100000:2.0:1783947366.648244:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014464 00000100:00100000:2.0:1783947366.648320:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947366.648330:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236014464:12345-0@lo:13: 00002000:00000024:2.0:1783947366.648358:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947366.648408:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236014464:12345-0@lo:13: Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947366.648416:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1783947366.648480:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2d80 x1870604236014464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947366.648502:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236014464:0@lo:13: 00000100:00080000:0.0:1783947366.648634:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1783947366.672401:0:10080:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947366.672415:0:10080:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1783947367.109559:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.109646:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213944448 00000100:00100000:1.0:1783947367.109660:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213944448 00000100:00100000:1.0:1783947367.109724:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 179 00000100:00100000:1.0:1783947367.109735:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2405:x1870604213944448:12345-192.168.204.3@tcp:250: 00010000:00080000:1.0:1783947367.109770:0:6505:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 45d06cee-8339-4f75-880b-33b7e0c9e5a1@192.168.204.3@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1783947367.109807:0:6505:0:(genops.c:1406:class_connect()) connect: client 45d06cee-8339-4f75-880b-33b7e0c9e5a1, cookie 0xe6fd1fdb55500107 00000100:00080000:1.0:1783947367.110118:0:6505:0:(import.c:65:import_set_state_nolock()) ffff9e7ac588c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947367.110209:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+5:2405:x1870604213944448:12345-192.168.204.3@tcp:250: Request processed in 474us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947367.110218:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 179 00000100:00100000:2.0:1783947367.119417:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.119872:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213944576 00000100:00100000:1.0:1783947367.119887:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213944576 00000100:00100000:1.0:1783947367.119961:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:1.0:1783947367.119973:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+5:6165:x1870604213944576:12345-192.168.204.3@tcp:101: 00010000:00010000:1.0:1783947367.119994:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947367.120016:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3d20 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947367.120067:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947367.120081:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947367.120091:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439200, rc 0) 00000100:00100000:1.0:1783947367.120163:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+6:6165:x1870604213944576:12345-192.168.204.3@tcp:101: Request processed in 192us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947367.120192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:0.0:1783947367.126877:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.127017:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213944704 00000100:00100000:1.0:1783947367.127031:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213944704 00000100:00100000:1.0:1783947367.127141:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:1.0:1783947367.127154:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+6:6165:x1870604213944704:12345-192.168.204.3@tcp:501: 00000100:00100000:1.0:1783947367.127350:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+6:6165:x1870604213944704:12345-192.168.204.3@tcp:501: Request processed in 199us (489us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947367.127359:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:3.0:1783947367.129155:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947367.129436:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213944832 00000100:00100000:0.0:1783947367.129447:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213944832 00000100:00100000:0.0:1783947367.129518:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:0.0:1783947367.129528:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+6:6165:x1870604213944832:12345-192.168.204.3@tcp:101: 00010000:00010000:0.0:1783947367.129549:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947367.129571:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3d27 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947367.129608:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947367.129859:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947367.129872:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a400, rc 0) 00000100:00100000:0.0:1783947367.129952:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+7:6165:x1870604213944832:12345-192.168.204.3@tcp:101: Request processed in 425us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947367.129959:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:3.0:1783947367.131555:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947367.131799:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213944960 00000100:00100000:0.0:1783947367.131810:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213944960 00000100:00100000:0.0:1783947367.131887:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:0.0:1783947367.131897:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+7:6165:x1870604213944960:12345-192.168.204.3@tcp:501: 00000100:00100000:0.0:1783947367.132086:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6165:x1870604213944960:12345-192.168.204.3@tcp:501: Request processed in 190us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947367.132094:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:3.0:1783947367.133693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947367.133889:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945088 00000100:00100000:0.0:1783947367.133899:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945088 00000100:00100000:0.0:1783947367.133955:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:0.0:1783947367.133965:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6165:x1870604213945088:12345-192.168.204.3@tcp:503: 00000100:00100000:0.0:1783947367.134141:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6165:x1870604213945088:12345-192.168.204.3@tcp:503: Request processed in 177us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947367.134150:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:3.0:1783947367.136718:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947367.137035:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945216 00000100:00100000:2.0:1783947367.137048:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945216 00000100:00100000:2.0:1783947367.137118:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:2.0:1783947367.137131:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6183:x1870604213945216:12345-192.168.204.3@tcp:502: 00000100:00100000:2.0:1783947367.137340:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6183:x1870604213945216:12345-192.168.204.3@tcp:502: Request processed in 211us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947367.137350:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:2.0:1783947367.156652:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236014592:0@lo:41: 00000100:00100000:2.0:1783947367.156769:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947367.157119:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014592 00000100:00100000:3.0:1783947367.157130:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014592 00000100:00100000:3.0:1783947367.157198:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947367.157210:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236014592:12345-0@lo:41: 00000004:00000024:3.0:1783947367.157259:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947367.157342:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236014592:12345-0@lo:41: Request processed in 135us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947367.157350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947367.157545:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236014592:0@lo:41: 00000100:00100000:3.0:1783947367.176135:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947367.180251:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945344 00000100:00100000:0.0:1783947367.180271:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945344 00000100:00100000:0.0:1783947367.180438:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 186 00000100:00100000:0.0:1783947367.180450:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6183:x1870604213945344:12345-192.168.204.3@tcp:502: 00000100:00100000:0.0:1783947367.180673:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6183:x1870604213945344:12345-192.168.204.3@tcp:502: Request processed in 225us (4551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947367.180682:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 186 00000100:00100000:0.0:1783947367.189895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.190212:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945472 00000100:00100000:1.0:1783947367.190226:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945472 00000100:00100000:1.0:1783947367.190312:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 187 00000100:00100000:1.0:1783947367.190325:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6165:x1870604213945472:12345-192.168.204.3@tcp:101: 00010000:00010000:1.0:1783947367.190355:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947367.190378:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb5550011c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3d58 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947367.190415:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb5550011c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d58 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947367.190428:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb5550011c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d58 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947367.190438:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439c00, rc 0) 00000100:00100000:1.0:1783947367.190546:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6165:x1870604213945472:12345-192.168.204.3@tcp:101: Request processed in 224us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947367.190553:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 187 00000100:00100000:3.0:1783947367.195845:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947367.196044:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945600 00000100:00100000:0.0:1783947367.196057:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945600 00000100:00100000:0.0:1783947367.196122:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 188 00000100:00100000:0.0:1783947367.196133:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6165:x1870604213945600:12345-192.168.204.3@tcp:256: 20000000:01000000:0.0:1783947367.196167:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783947367.196199:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783947367.196209:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783947367.196212:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783947367.196215:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783947367.196218:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783947367.198909:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6165:x1870604213945600:12345-192.168.204.3@tcp:256: Request processed in 2761us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947367.198927:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 188 00000100:00100000:3.0:1783947367.203291:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947367.203438:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945728 00000100:00100000:2.0:1783947367.203451:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945728 00000100:00100000:2.0:1783947367.203576:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:2.0:1783947367.203588:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6165:x1870604213945728:12345-192.168.204.3@tcp:101: 00010000:00010000:2.0:1783947367.203608:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947367.203630:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3d5f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947367.203665:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947367.203677:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947367.203688:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ec00, rc 0) 00000100:00100000:2.0:1783947367.203762:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6165:x1870604213945728:12345-192.168.204.3@tcp:101: Request processed in 176us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947367.203770:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:1.0:1783947367.206581:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947367.206765:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945856 00000100:00100000:0.0:1783947367.206777:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945856 00000100:00100000:0.0:1783947367.206897:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:0.0:1783947367.206908:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6165:x1870604213945856:12345-192.168.204.3@tcp:501: 00000100:00100000:0.0:1783947367.207105:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6165:x1870604213945856:12345-192.168.204.3@tcp:501: Request processed in 199us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947367.207114:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:2.0:1783947367.209141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.209721:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213945984 00000100:00100000:1.0:1783947367.209736:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213945984 00000100:00100000:1.0:1783947367.209806:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:1.0:1783947367.209819:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6165:x1870604213945984:12345-192.168.204.3@tcp:503: 00000100:00100000:1.0:1783947367.210005:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6165:x1870604213945984:12345-192.168.204.3@tcp:503: Request processed in 189us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947367.210014:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:2.0:1783947367.213705:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.213890:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213946112 00000100:00100000:1.0:1783947367.213903:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213946112 00000100:00100000:1.0:1783947367.214014:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:1.0:1783947367.214024:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6188:x1870604213946112:12345-192.168.204.3@tcp:502: 00000100:00100000:1.0:1783947367.214206:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6188:x1870604213946112:12345-192.168.204.3@tcp:502: Request processed in 183us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947367.214214:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:2.0:1783947367.216538:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.216644:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213946240 00000100:00100000:1.0:1783947367.216656:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213946240 00000100:00100000:1.0:1783947367.216716:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:1.0:1783947367.216725:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6188:x1870604213946240:12345-192.168.204.3@tcp:502: 00000100:00100000:1.0:1783947367.216893:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6188:x1870604213946240:12345-192.168.204.3@tcp:502: Request processed in 168us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947367.216902:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:2.0:1783947367.219863:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947367.220345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213946368 00000100:00100000:1.0:1783947367.220358:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213946368 00000100:00100000:1.0:1783947367.220505:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1783947367.220516:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1870604213946368:12345-192.168.204.3@tcp:38: 00010000:00080000:1.0:1783947367.220552:0:6512:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1783947367.220627:0:6512:0:(genops.c:1406:class_connect()) connect: client 1eb923ac-790a-478f-897e-124614dbce09, cookie 0xe6fd1fdb5550012a 00000004:00100000:1.0:1783947367.220655:0:6512:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783947367.220929:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9e7ac588a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947367.221014:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2405:x1870604213946368:12345-192.168.204.3@tcp:38: Request processed in 498us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947367.221023:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947367.221859:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947367.221963:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213946624 00000100:00100000:0.0:1783947367.221971:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213946624 00000100:00100000:0.0:1783947367.222014:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1783947367.222021:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1870604213946624:12345-192.168.204.3@tcp:38: 00010000:00080000:0.0:1783947367.222047:0:8291:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1783947367.222090:0:8291:0:(genops.c:1406:class_connect()) connect: client 1eb923ac-790a-478f-897e-124614dbce09, cookie 0xe6fd1fdb55500131 00000004:00100000:0.0:1783947367.222113:0:8291:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783947367.222346:0:8291:0:(import.c:65:import_set_state_nolock()) ffff9e7ac65c5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947367.222565:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2405:x1870604213946624:12345-192.168.204.3@tcp:38: Request processed in 542us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947367.222573:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00010000:00010000:1.0:1783947367.603879:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947368.180330:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236014720:0@lo:400: 00000100:00100000:3.0:1783947368.180443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.180562:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947368.180568:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236014848:0@lo:400: 00000100:00100000:3.0:1783947368.180602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.180655:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236014976:0@lo:400: 00000100:00100000:3.0:1783947368.180685:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.180919:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236015488:0@lo:400: 00000100:00100000:2.0:1783947368.180950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.181011:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236015360:0@lo:400: 00000100:00100000:3.0:1783947368.181152:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236015104:0@lo:400: 00000100:00100000:0.0:1783947368.181201:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014976 00000100:00100000:0.0:1783947368.181217:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014976 00000100:00100000:0.0:1783947368.181289:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783947368.181299:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236014976:12345-0@lo:400: 00000100:00100000:3.0:1783947368.187192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.187249:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236015616:0@lo:400: 00000100:00100000:3.0:1783947368.187305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.187348:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236016128:0@lo:400: 00000100:00100000:3.0:1783947368.187373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947368.187419:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014848 00000100:00100000:3.0:1783947368.187429:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014848 00000100:00100000:3.0:1783947368.187499:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236015488 00000100:00100000:3.0:1783947368.187503:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236015488 00000100:00100000:3.0:1783947368.187541:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236015104 00000100:00100000:3.0:1783947368.187544:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236015104 00000100:00100000:3.0:1783947368.187560:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947368.187568:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236014848:12345-0@lo:400: 00000100:00100000:3.0:1783947368.187626:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236014848:12345-0@lo:400: Request processed in 59us (7023us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.187633:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947368.187669:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947368.187675:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236015488:12345-0@lo:400: 00000100:00100000:3.0:1783947368.187707:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236015488:12345-0@lo:400: Request processed in 32us (6756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.187712:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947368.187723:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783947368.187729:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236015104:12345-0@lo:400: 00000100:00100000:3.0:1783947368.187760:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236015104:12345-0@lo:400: Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.187765:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1783947368.187807:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7147100 x1870604236015104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.187822:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236015104:0@lo:400: 00000100:00100000:3.0:1783947368.187970:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236015616 00000100:00100000:3.0:1783947368.187974:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236015616 00000100:00080000:0.0:1783947368.189534:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947368.189546:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947368.189948:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236014976:12345-0@lo:400: Request processed in 8641us (9252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.189962:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1783947368.192385:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7146300 x1870604236015488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947368.192409:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236015488:0@lo:400: 00000100:00100000:2.0:1783947368.192423:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236016000:0@lo:400: 00000100:00100000:2.0:1783947368.193654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947368.193725:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236014976:0@lo:400: 00000100:00100000:2.0:1783947368.193794:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016128 00000100:00100000:2.0:1783947368.193802:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016128 00000100:00100000:0.0:1783947368.193812:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236014720 00000100:00100000:0.0:1783947368.193819:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236014720 00000100:00100000:2.0:1783947368.193873:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783947368.193873:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1783947368.193891:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236015616:12345-0@lo:400: 00000100:00100000:0.0:1783947368.193892:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236014720:12345-0@lo:400: 00000100:00100000:3.0:1783947368.194060:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947368.194071:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236016128:12345-0@lo:400: 00000100:00100000:1.0:1783947368.194194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016000 00000100:00100000:1.0:1783947368.194200:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016000 00000100:00100000:1.0:1783947368.194243:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947368.194251:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236016000:12345-0@lo:400: 00000100:00100000:0.0:1783947368.196393:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236014720:12345-0@lo:400: Request processed in 2494us (15936us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.196408:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1783947368.196929:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947368.196938:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947368.196973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.197022:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236015872:0@lo:400: 00000100:00100000:0.0:1783947368.197108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.197140:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236016384:0@lo:13: 00000100:00100000:0.0:1783947368.197169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.197192:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783947368.197199:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236015232:0@lo:400: 00000100:00100000:3.0:1783947368.198036:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236016128:12345-0@lo:400: Request processed in 3960us (10653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.198049:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783947368.198121:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7146d80 x1870604236014848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.198138:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236014848:0@lo:400: 00000100:00100000:3.0:1783947368.198152:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236014720:0@lo:400: 00010000:00080000:3.0:1783947368.198195:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5842680 x1870604236016128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.198215:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783947368.198241:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236016128:0@lo:400: 00000100:00100000:3.0:1783947368.198295:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016384 00000100:00100000:3.0:1783947368.198312:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016384 00000100:00100000:0.0:1783947368.198334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.198373:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236015744:0@lo:400: 00000100:00100000:3.0:1783947368.198379:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947368.198391:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236016384:12345-0@lo:13: 00000100:00100000:0.0:1783947368.198408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1783947368.198431:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947368.198442:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236016256:0@lo:400: 00000100:00100000:3.0:1783947368.198495:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236016384:12345-0@lo:13: Request processed in 106us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.198502:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1783947368.198530:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947368.198564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783947368.198598:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cea680 x1870604236016384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.198606:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236015744 00000100:00100000:0.0:1783947368.198609:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1783947368.198611:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236015744 00000100:00100000:0.0:1783947368.198631:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236016384:0@lo:13: 00000100:00100000:3.0:1783947368.198645:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016256 00000100:00100000:3.0:1783947368.198648:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016256 00000100:00100000:3.0:1783947368.198667:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947368.198675:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236015744:12345-0@lo:400: 00000100:00100000:3.0:1783947368.198720:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236015744:12345-0@lo:400: Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.198726:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947368.198737:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947368.198743:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236016256:12345-0@lo:400: 00000100:00100000:3.0:1783947368.198769:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236016256:12345-0@lo:400: Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.198775:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1783947368.198788:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947368.198817:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5843b80 x1870604236015744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.198827:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236015744:0@lo:400: 00010000:00080000:3.0:1783947368.198837:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5841c00 x1870604236016256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.198845:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236016256:0@lo:400: 00000100:00100000:3.0:1783947368.198885:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236015232 00000100:00100000:3.0:1783947368.198890:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236015232 00000100:00100000:3.0:1783947368.198919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947368.198925:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236015232:12345-0@lo:400: 00000100:00100000:3.0:1783947368.198966:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236015232:12345-0@lo:400: Request processed in 41us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.198973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947368.198997:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236015232:0@lo:400: 00000100:00100000:0.0:1783947368.199308:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236015360 00000100:00100000:0.0:1783947368.199316:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236015360 00000100:00100000:0.0:1783947368.199359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236015872 00000100:00100000:0.0:1783947368.199363:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236015872 00000100:00100000:0.0:1783947368.199380:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783947368.199386:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236015360:12345-0@lo:400: 00000100:00100000:0.0:1783947368.199426:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236015360:12345-0@lo:400: Request processed in 41us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.199432:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783947368.199444:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783947368.199449:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236015872:12345-0@lo:400: 00000100:00100000:0.0:1783947368.199839:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236015872:12345-0@lo:400: Request processed in 387us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.199846:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1783947368.204090:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783947368.204186:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7145880 x1870604236015360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.204208:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236015360:0@lo:400: 00010000:00080000:3.0:1783947368.204225:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5842a00 x1870604236015872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.204233:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236015872:0@lo:400: 00000100:00100000:2.0:1783947368.212141:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236015616:12345-0@lo:400: Request processed in 18240us (24818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.212160:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783947368.212433:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5842300 x1870604236015616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.212451:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236015616:0@lo:400: 00000100:00100000:1.0:1783947368.214590:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236016000:12345-0@lo:400: Request processed in 20327us (20930us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.214616:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1783947368.214673:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5841f80 x1870604236016000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947368.214692:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236016000:0@lo:400: 00000100:00100000:2.0:1783947368.233149:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947368.233202:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947368.233258:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947368.233443:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213946880 00000100:00100000:2.0:1783947368.233495:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213946880 00000100:00080000:2.0:1783947368.233613:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947368.233663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213946752 00000100:00100000:2.0:1783947368.233667:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213946752 00000100:00080000:2.0:1783947368.233684:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947368.233698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213946496 00000100:00100000:2.0:1783947368.233701:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213946496 00000100:00100000:1.0:1783947368.233741:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1783947368.233756:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+7:6165:x1870604213946880:12345-192.168.204.3@tcp:41: 00000004:00000024:1.0:1783947368.233811:0:8291:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783947368.233899:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+7:6165:x1870604213946880:12345-192.168.204.3@tcp:41: Request processed in 147us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.234169:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:1.0:1783947368.236275:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1783947368.236365:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1783947368.236389:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:0:x1870604213946496:12345-192.168.204.3@tcp:41: 00000004:00000024:1.0:1783947368.236432:0:8291:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783947368.236562:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:0:x1870604213946496:12345-192.168.204.3@tcp:41: Request processed in 187us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.236571:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:3.0:1783947368.236832:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:0:x1870604213946752:12345-192.168.204.3@tcp:41: 00000004:00000024:3.0:1783947368.236868:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947368.238655:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:0:x1870604213946752:12345-192.168.204.3@tcp:41: Request processed in 2870us (3844us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947368.238672:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1783947368.242689:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947368.242886:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947008 00000100:00100000:1.0:1783947368.242964:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947008 00000100:00100000:1.0:1783947368.243043:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:1.0:1783947368.243162:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:6165:x1870604213947008:12345-192.168.204.3@tcp:40: 00000100:00100000:1.0:1783947368.243339:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:6165:x1870604213947008:12345-192.168.204.3@tcp:40: Request processed in 182us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.243347:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:2.0:1783947368.251848:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947368.252018:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947368.252187:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947368.252267:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947368.253044:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947520 00000100:00100000:0.0:1783947368.253071:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947520 00000100:00100000:0.0:1783947368.253152:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:0.0:1783947368.253164:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213947520:12345-192.168.204.3@tcp:400: 00000100:00100000:0.0:1783947368.253263:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213947520:12345-192.168.204.3@tcp:400: Request processed in 102us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.253302:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:1.0:1783947368.254338:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947392 00000100:00100000:1.0:1783947368.254351:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947392 00000100:00100000:1.0:1783947368.254421:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:1.0:1783947368.254433:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1eb923ac-790a-478f-897e-124614dbce09+6:6165:x1870604213947392:12345-192.168.204.3@tcp:900: 00000100:00100000:1.0:1783947368.254536:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1eb923ac-790a-478f-897e-124614dbce09+6:6165:x1870604213947392:12345-192.168.204.3@tcp:900: Request processed in 106us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947368.254543:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1783947368.256805:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947136 00000100:00100000:0.0:1783947368.256823:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947136 00000100:00100000:0.0:1783947368.256874:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947264 00000100:00100000:0.0:1783947368.256877:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947264 00000100:00100000:3.0:1783947368.257107:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:3.0:1783947368.257119:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1870604213947136:12345-192.168.204.3@tcp:8: 00000100:00100000:0.0:1783947368.257799:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:0.0:1783947368.257808:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604213947264:12345-192.168.204.3@tcp:8: 00010000:00080000:0.0:1783947368.257837:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1783947368.257873:0:8427:0:(genops.c:1406:class_connect()) connect: client 1eb923ac-790a-478f-897e-124614dbce09, cookie 0xe6fd1fdb55500138 00002000:00100000:0.0:1783947368.257889:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1eb923ac-790a-478f-897e-124614dbce09/ffff9e7ac65c1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783947368.257955:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783947368.258432:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783947368.258505:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e7ac65c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947368.258598:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2405:x1870604213947264:12345-192.168.204.3@tcp:8: Request processed in 789us (6411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.258610:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00010000:00080000:2.0:1783947368.259233:0:8429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1783947368.259276:0:8429:0:(genops.c:1406:class_connect()) connect: client 1eb923ac-790a-478f-897e-124614dbce09, cookie 0xe6fd1fdb5550013f 00002000:00100000:2.0:1783947368.259296:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1eb923ac-790a-478f-897e-124614dbce09/ffff9e7ac73ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783947368.259316:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783947368.259627:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783947368.259656:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73c9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947368.259841:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2405:x1870604213947136:12345-192.168.204.3@tcp:8: Request processed in 2722us (8009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947368.259852:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:1.0:1783947368.266639:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947368.266755:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947648 00000100:00100000:0.0:1783947368.266767:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947648 00000100:00100000:0.0:1783947368.266826:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:0.0:1783947368.266837:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+6:6165:x1870604213947648:12345-192.168.204.3@tcp:33: 00000004:00080000:1.0:1783947368.285736:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18786us 00000004:00200000:0.0:1783947368.308635:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783947368.308943:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+6:6165:x1870604213947648:12345-192.168.204.3@tcp:33: Request processed in 42099us (42476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.308958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:3.0:1783947368.489949:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947368.491144:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947776 00000100:00100000:0.0:1783947368.491181:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947776 00000100:00100000:0.0:1783947368.491287:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1783947368.491301:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:6206:x1870604213947776:12345-192.168.204.3@tcp:101: 00010000:00010000:0.0:1783947368.491328:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947368.491358:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ae00/0xe6fd1fdb55500146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3d90 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.491745:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb5550014d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.491882:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb5550014d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.491902:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb5550014d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947368.491961:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947368.491966:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947368.491985:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb5550014d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.492017:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ae00/0xe6fd1fdb55500146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d90 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.492039:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb5550014d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d90 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947368.492049:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e4400) 00010000:00010000:0.0:1783947368.492052:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947368.492057:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9bc00, rc 0) 00000100:00100000:0.0:1783947368.492154:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+7:6206:x1870604213947776:12345-192.168.204.3@tcp:101: Request processed in 857us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.492163:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00010000:00010000:1.0:1783947368.629501:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947368.692553:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947368.692585:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236016512:0@lo:13: 00000100:00100000:1.0:1783947368.692695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947368.692980:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016512 00000100:00100000:0.0:1783947368.692990:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016512 00000100:00100000:0.0:1783947368.693067:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947368.693082:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236016512:12345-0@lo:13: 00002000:00000024:0.0:1783947368.693113:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947368.693177:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236016512:12345-0@lo:13: Request processed in 100us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947368.693185:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783947368.694050:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cbad80 x1870604236016512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947368.694087:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236016512:0@lo:13: 00010000:00010000:2.0:1783947369.652308:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947370.230654:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236016640:0@lo:41: 00000100:00100000:3.0:1783947370.230753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947370.231110:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016640 00000100:00100000:0.0:1783947370.231121:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016640 00000100:00100000:0.0:1783947370.231206:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783947370.231220:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236016640:12345-0@lo:41: 00000004:00000024:0.0:1783947370.231277:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783947370.231349:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236016640:12345-0@lo:41: Request processed in 133us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947370.231357:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947370.231496:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236016640:0@lo:41: 00000100:00100000:2.0:1783947370.305165:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947370.305303:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213947904 00000100:00100000:1.0:1783947370.305325:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213947904 00000100:00100000:1.0:1783947370.305763:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:1.0:1783947370.305791:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+7:6258:x1870604213947904:12345-192.168.204.3@tcp:41: 00000004:00000024:1.0:1783947370.305832:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783947370.305950:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+7:6258:x1870604213947904:12345-192.168.204.3@tcp:41: Request processed in 176us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947370.305959:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00080000:2.0:1783947370.306305:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947370.309678:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947370.309902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948032 00000100:00100000:0.0:1783947370.309915:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948032 00000100:00100000:0.0:1783947370.310017:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:0.0:1783947370.310052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:6258:x1870604213948032:12345-192.168.204.3@tcp:41: 00000004:00000024:0.0:1783947370.310110:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947370.310213:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:6258:x1870604213948032:12345-192.168.204.3@tcp:41: Request processed in 185us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947370.310220:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00080000:2.0:1783947370.310334:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947370.314763:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947370.315024:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948160 00000100:00100000:0.0:1783947370.315038:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948160 00000100:00100000:0.0:1783947370.315266:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:0.0:1783947370.315296:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1eb923ac-790a-478f-897e-124614dbce09+6:6258:x1870604213948160:12345-192.168.204.3@tcp:13: 00002000:00000024:0.0:1783947370.315339:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947370.315431:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1eb923ac-790a-478f-897e-124614dbce09+6:6258:x1870604213948160:12345-192.168.204.3@tcp:13: Request processed in 155us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947370.315439:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00080000:2.0:1783947370.315876:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947370.317570:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947370.317658:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948288 00000100:00100000:0.0:1783947370.317669:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948288 00000100:00100000:0.0:1783947370.317745:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00080000:2.0:1783947370.317861:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947370.317893:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1eb923ac-790a-478f-897e-124614dbce09+6:6258:x1870604213948288:12345-192.168.204.3@tcp:13: 00002000:00000024:0.0:1783947370.317935:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947370.318011:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1eb923ac-790a-478f-897e-124614dbce09+6:6258:x1870604213948288:12345-192.168.204.3@tcp:13: Request processed in 255us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947370.318018:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00010000:00010000:1.0:1783947370.680831:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947371.699940:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947371.765724:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947371.765756:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236016768:0@lo:13: 00000100:00100000:1.0:1783947371.765842:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947371.765971:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016768 00000100:00100000:2.0:1783947371.765980:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016768 00000100:00100000:2.0:1783947371.766052:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947371.766064:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236016768:12345-0@lo:13: 00002000:00000024:2.0:1783947371.766090:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947371.766142:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236016768:12345-0@lo:13: Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947371.766171:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783947371.766230:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7be78d8e00 x1870604236016768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947371.766250:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236016768:0@lo:13: 00000100:00080000:1.0:1783947371.766311:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947371.766393:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236016896:0@lo:13: 00000100:00100000:0.0:1783947371.766421:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947371.766446:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236016896 00000100:00100000:0.0:1783947371.766449:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236016896 00000100:00100000:0.0:1783947371.766500:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947371.766506:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236016896:12345-0@lo:13: 00002000:00000024:0.0:1783947371.766516:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947371.766542:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236016896:12345-0@lo:13: Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947371.766548:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1783947371.766578:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8380 x1870604236016896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947371.766590:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236016896:0@lo:13: 00000100:00080000:1.0:1783947371.770684:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947372.276764:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236017024:0@lo:41: 00000100:00100000:2.0:1783947372.276865:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947372.277244:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017024 00000100:00100000:3.0:1783947372.277255:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017024 00000100:00100000:3.0:1783947372.277327:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783947372.277339:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236017024:12345-0@lo:41: 00000004:00000024:3.0:1783947372.277386:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947372.277449:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236017024:12345-0@lo:41: Request processed in 112us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947372.277486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783947372.277523:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236017024:0@lo:41: 00010000:00010000:2.0:1783947372.724602:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783947372.786002:0:10178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1783947372.802828:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000001:00100000:0.0:1783947372.806292:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000001:00100000:3.0:1783947372.809825:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000100:00100000:0.0:1783947373.300765:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236017152:0@lo:13: 00000100:00100000:0.0:1783947373.300886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947373.301126:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017152 00000100:00100000:1.0:1783947373.301138:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017152 00000100:00100000:1.0:1783947373.301268:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947373.301283:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236017152:12345-0@lo:13: 00002000:00000024:1.0:1783947373.301351:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947373.301409:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236017152:12345-0@lo:13: Request processed in 130us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947373.301442:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783947373.302356:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783947373.302420:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ceaa00 x1870604236017152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947373.302450:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236017152:0@lo:13: 00000100:00100000:3.0:1783947373.302837:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236017536:0@lo:400: 00000100:00100000:3.0:1783947373.302907:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947373.302949:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236018048:0@lo:400: 00000100:00100000:3.0:1783947373.302978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947373.303002:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236018560:0@lo:400: 00000100:00100000:3.0:1783947373.303029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947373.303063:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783947373.303069:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236017664:0@lo:400: 00000100:00100000:3.0:1783947373.303092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947373.303110:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236018176:0@lo:400: 00000100:00100000:3.0:1783947373.303137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947373.303152:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236018688:0@lo:400: 00000100:00100000:3.0:1783947373.303174:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947373.303224:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018048 00000100:00100000:3.0:1783947373.303231:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018048 00000100:00100000:3.0:1783947373.303292:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018560 00000100:00100000:3.0:1783947373.303295:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018560 00000100:00100000:3.0:1783947373.303310:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017664 00000100:00100000:3.0:1783947373.303313:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017664 00000100:00100000:3.0:1783947373.303331:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783947373.303340:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236018048:12345-0@lo:400: 00000100:00100000:3.0:1783947373.303397:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236018048:12345-0@lo:400: Request processed in 58us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947373.303405:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783947373.303421:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947373.303426:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236018560:12345-0@lo:400: 00000100:00100000:3.0:1783947373.303600:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236018560:12345-0@lo:400: Request processed in 173us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947373.303607:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947373.303619:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947373.303626:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236017664:12345-0@lo:400: 00000100:00100000:3.0:1783947373.303653:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236017664:12345-0@lo:400: Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947373.303659:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1783947373.303687:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947373.303716:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236017664:0@lo:400: 00010000:00080000:3.0:1783947373.303730:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d69880 x1870604236018048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947373.303741:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236018048:0@lo:400: 00010000:00080000:3.0:1783947373.303750:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640a680 x1870604236018560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947373.303757:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236018560:0@lo:400: 00000100:00100000:2.0:1783947373.303951:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236017280:0@lo:400: 00000100:00100000:2.0:1783947373.303992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947373.304028:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236017792:0@lo:400: 00000100:00100000:2.0:1783947373.304051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947373.304070:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236018304:0@lo:400: 00000100:00100000:2.0:1783947373.304092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947373.304115:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783947373.304122:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236017408:0@lo:400: 00000100:00100000:2.0:1783947373.304144:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947373.304160:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236017920:0@lo:400: 00000100:00100000:2.0:1783947373.304178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947373.304206:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236018432:0@lo:400: 00000100:00100000:2.0:1783947373.304232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947373.304261:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018176 00000100:00100000:2.0:1783947373.304266:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018176 00000100:00100000:2.0:1783947373.304319:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018688 00000100:00100000:2.0:1783947373.304323:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018688 00000100:00100000:2.0:1783947373.304341:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018304 00000100:00100000:2.0:1783947373.304343:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018304 00000100:00100000:2.0:1783947373.304357:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947373.304363:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236018176:12345-0@lo:400: 00000100:00100000:2.0:1783947373.304409:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236018176:12345-0@lo:400: Request processed in 46us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947373.304416:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783947373.304428:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947373.304434:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236018688:12345-0@lo:400: 00000100:00100000:2.0:1783947373.304487:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236018688:12345-0@lo:400: Request processed in 53us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947373.304493:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947373.304609:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017280 00000100:00100000:3.0:1783947373.304614:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017280 00000100:00100000:3.0:1783947373.304643:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783947373.304649:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236017280:12345-0@lo:400: 00000100:00100000:3.0:1783947373.304693:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236017280:12345-0@lo:400: Request processed in 45us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947373.304700:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783947373.304823:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947373.304836:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236018304:12345-0@lo:400: 00000100:00100000:0.0:1783947373.304872:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236018304:12345-0@lo:400: Request processed in 42us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947373.304877:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947373.304945:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017536 00000100:00100000:0.0:1783947373.304949:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017536 00000100:00100000:0.0:1783947373.304976:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017792 00000100:00100000:0.0:1783947373.304979:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017792 00000100:00100000:0.0:1783947373.304991:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947373.304996:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236017536:12345-0@lo:400: 00000100:00100000:0.0:1783947373.305030:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236017536:12345-0@lo:400: Request processed in 34us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947373.305036:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947373.305046:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947373.305051:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236017792:12345-0@lo:400: 00000100:00100000:0.0:1783947373.305090:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236017792:12345-0@lo:400: Request processed in 38us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947373.305095:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947373.305113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017408 00000100:00100000:0.0:1783947373.305116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017408 00000100:00100000:0.0:1783947373.305151:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236017920 00000100:00100000:0.0:1783947373.305154:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236017920 00000100:00100000:0.0:1783947373.305166:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018432 00000100:00100000:0.0:1783947373.305169:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018432 00000100:00100000:0.0:1783947373.305192:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783947373.305198:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236017408:12345-0@lo:400: 00000100:00100000:0.0:1783947373.305229:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236017408:12345-0@lo:400: Request processed in 31us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947373.305235:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783947373.305245:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947373.305251:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236017920:12345-0@lo:400: 00000100:00100000:0.0:1783947373.305274:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236017920:12345-0@lo:400: Request processed in 23us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947373.305279:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947373.305289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947373.305295:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236018432:12345-0@lo:400: 00000100:00100000:0.0:1783947373.305319:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236018432:12345-0@lo:400: Request processed in 25us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947373.305324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947373.305386:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236017408:0@lo:400: 00000100:00100000:0.0:1783947373.305396:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236017920:0@lo:400: 00000100:00100000:0.0:1783947373.305417:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236018432:0@lo:400: 00000100:00100000:0.0:1783947373.305426:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236017280:0@lo:400: 00000100:00100000:0.0:1783947373.305435:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236017792:0@lo:400: 00010000:00080000:0.0:1783947373.305450:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6409f80 x1870604236018304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947373.305486:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236018304:0@lo:400: 00000100:00080000:3.0:1783947373.305643:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947373.305649:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947373.305658:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947373.305854:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640ad80 x1870604236018176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947373.305866:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236018176:0@lo:400: 00010000:00080000:2.0:1783947373.305880:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640aa00 x1870604236018688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947373.305887:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236018688:0@lo:400: 00000100:00100000:2.0:1783947373.305899:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236017536:0@lo:400: 00000100:00100000:1.0:1783947373.547575:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947373.547637:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947373.547661:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948416 00000100:00100000:3.0:1783947373.547675:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948416 00000100:00100000:1.0:1783947373.547680:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947373.547713:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947373.547749:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:1.0:1783947373.547750:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947373.547768:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604213948416:12345-192.168.204.3@tcp:400: 00000100:00100000:1.0:1783947373.547784:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948928 00000100:00100000:1.0:1783947373.547789:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948928 00000100:00100000:3.0:1783947373.547857:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604213948416:12345-192.168.204.3@tcp:400: Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947373.547861:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948800 00000100:00100000:1.0:1783947373.547865:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948800 00000100:00100000:3.0:1783947373.547869:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:1.0:1783947373.547903:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1783947373.547926:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213948928:12345-192.168.204.3@tcp:400: 00000100:00100000:1.0:1783947373.547967:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213948928:12345-192.168.204.3@tcp:400: Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947373.547976:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1783947373.548003:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1783947373.548013:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213948800:12345-192.168.204.3@tcp:400: 00000100:00100000:1.0:1783947373.548051:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213948800:12345-192.168.204.3@tcp:400: Request processed in 38us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947373.548058:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1783947373.548093:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948672 00000100:00100000:1.0:1783947373.548097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948672 00000100:00080000:3.0:1783947373.548101:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947373.548108:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947373.548114:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947373.548152:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213948544 00000100:00100000:1.0:1783947373.548157:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213948544 00000100:00100000:3.0:1783947373.548168:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:3.0:1783947373.548194:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213948672:12345-192.168.204.3@tcp:400: 00000100:00100000:3.0:1783947373.548240:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213948672:12345-192.168.204.3@tcp:400: Request processed in 62us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947373.548248:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00080000:3.0:1783947373.548295:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947373.548368:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:1.0:1783947373.548382:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213948544:12345-192.168.204.3@tcp:400: 00000100:00100000:1.0:1783947373.548442:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213948544:12345-192.168.204.3@tcp:400: Request processed in 65us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947373.553501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00010000:00010000:1.0:1783947373.758976:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947373.812022:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947373.812065:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236018816:0@lo:13: 00000100:00100000:0.0:1783947373.812161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947373.812251:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018816 00000100:00100000:0.0:1783947373.812260:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018816 00000100:00100000:0.0:1783947373.812318:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947373.812328:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236018816:12345-0@lo:13: 00002000:00000024:0.0:1783947373.812357:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947373.812408:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236018816:12345-0@lo:13: Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947373.812416:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1783947373.812492:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cbb800 x1870604236018816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947373.812513:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236018816:0@lo:13: 00000001:00100000:0.0:1783947373.827451:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00010000:00010000:1.0:1783947374.772899:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947375.348215:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236018944:0@lo:41: 00000100:00100000:0.0:1783947375.348320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947375.350332:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236018944 00000100:00100000:2.0:1783947375.350353:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236018944 00000100:00100000:2.0:1783947375.350505:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947375.350569:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236018944:12345-0@lo:41: 00000004:00000024:2.0:1783947375.350619:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783947375.351112:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236018944:12345-0@lo:41: Request processed in 546us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947375.354911:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236018944:0@lo:41: 00000100:00100000:2.0:1783947375.356056:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:2.0:1783947375.795606:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947376.322642:0:10326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4e3fb430 20000000:00000080:2.0:1783947376.322667:0:10326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7ac763b400 uarg=0000000000000000 20000000:01000000:2.0:1783947376.322721:0:10326:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783947376.322724:0:10326:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783947376.322728:0:10326:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783947376.322733:0:10326:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783947376.322740:0:10326:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783947376.322818:0:10326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783947376.322822:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783947376.324186:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1783947376.324861:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1783947376.324904:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1783947376.324920:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1783947376.324934:0:10326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783947376.324937:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783947376.326119:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1783947376.327110:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1783947376.327166:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1783947376.327182:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1783947376.327195:0:10326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783947376.327199:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783947376.328162:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1783947376.329055:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1783947376.329098:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1783947376.329149:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1783947376.329168:0:10326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783947376.329172:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783947376.330427:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1783947376.331072:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1783947376.331105:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1783947376.331136:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1783947376.331149:0:10326:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783947376.331152:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783947376.332031:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1783947376.332264:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1783947376.332295:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1783947376.332311:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1783947376.332340:0:10326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783947376.332365:0:10326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332386:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332394:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332401:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332410:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332417:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332424:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332690:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332698:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332705:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332716:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332723:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332731:0:10326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332778:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.332798:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 9 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.332817:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019072:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947376.332995:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333006:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 9 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333023:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019200:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947376.333057:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333065:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 23 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333076:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019328:0@lo:104: 00000100:00100000:3.0:1783947376.333137:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947376.333181:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333190:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333198:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019456:0@lo:104: 00000100:00100000:3.0:1783947376.333221:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947376.333242:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333251:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 23 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333259:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019584:0@lo:104: 00000100:00100000:3.0:1783947376.333279:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947376.333306:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333327:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 23 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333337:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019712:0@lo:104: 00000100:00100000:3.0:1783947376.333362:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947376.333390:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333398:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 23 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333405:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019840:0@lo:104: 00010000:00010000:3.0:1783947376.333429:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333449:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 23 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333479:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019968:0@lo:104: 00010000:00010000:3.0:1783947376.333505:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.333524:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 23 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.333534:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236020096:0@lo:104: 00000100:00100000:2.0:1783947376.333743:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783947376.333763:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.333776:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.333785:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.333800:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236019328 00000100:00100000:2.0:1783947376.333808:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236019328 00000100:00100000:2.0:1783947376.333853:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236019456 00000100:00100000:2.0:1783947376.333856:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236019456 00000100:00100000:2.0:1783947376.333865:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236019584 00000100:00100000:2.0:1783947376.333868:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236019584 00000100:00100000:2.0:1783947376.333877:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236019712 00000100:00100000:2.0:1783947376.333879:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236019712 00000100:00100000:2.0:1783947376.333887:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236019840 00000100:00100000:2.0:1783947376.333889:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236019840 00000100:00100000:2.0:1783947376.333897:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236019968 00000100:00100000:2.0:1783947376.333899:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236019968 00000100:00100000:2.0:1783947376.333907:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020096 00000100:00100000:2.0:1783947376.333916:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020096 00000100:00100000:2.0:1783947376.333933:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947376.333942:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:10326:x1870604236019328:12345-0@lo:104: 00010000:00010000:2.0:1783947376.333958:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334014:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947376.334021:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+9:10326:x1870604236019328:12345-0@lo:104: Request processed in 79us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.334028:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947376.334047:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947376.334053:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+8:10326:x1870604236019456:12345-0@lo:104: 00010000:00010000:2.0:1783947376.334061:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334092:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947376.334097:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+8:10326:x1870604236019456:12345-0@lo:104: Request processed in 45us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.334103:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947376.334113:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947376.334119:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+7:10326:x1870604236019584:12345-0@lo:104: 00010000:00010000:2.0:1783947376.334140:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334171:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783947376.334177:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+7:10326:x1870604236019584:12345-0@lo:104: Request processed in 58us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.334183:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947376.334201:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947376.334207:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:10326:x1870604236019712:12345-0@lo:104: 00010000:00010000:2.0:1783947376.334215:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334241:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783947376.334246:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:10326:x1870604236019712:12345-0@lo:104: Request processed in 40us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.334252:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947376.334290:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947376.334296:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:10326:x1870604236019840:12345-0@lo:104: 00010000:00010000:2.0:1783947376.334304:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334327:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1783947376.334332:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:10326:x1870604236019840:12345-0@lo:104: Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.334338:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947376.334347:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947376.334353:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:10326:x1870604236019968:12345-0@lo:104: 00010000:00010000:2.0:1783947376.334360:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334381:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1783947376.334386:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:10326:x1870604236019968:12345-0@lo:104: Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.334392:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947376.334409:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947376.334415:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:10326:x1870604236020096:12345-0@lo:104: 00010000:00010000:2.0:1783947376.334423:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334485:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1783947376.334491:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:10326:x1870604236020096:12345-0@lo:104: Request processed in 76us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.334496:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1783947376.334522:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783947376.334529:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334537:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947376.334542:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334551:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947376.334675:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947376.334684:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947376.334723:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334730:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947376.334754:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334773:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb555000f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500100 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334789:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783947376.334793:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334799:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c02052200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947376.334803:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334810:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947376.334817:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947376.334823:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947376.334836:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334842:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947376.334847:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334854:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555000cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555000d6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334864:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783947376.334872:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334878:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c2a00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947376.334882:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334889:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947376.334896:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947376.334902:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947376.334913:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334919:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947376.334942:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334950:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2a00/0xe6fd1fdb555000b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555000ba expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334960:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783947376.334964:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334970:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c3200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947376.334973:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.334989:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947376.334996:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947376.335002:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947376.335014:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335020:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947376.335025:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335032:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3200/0xe6fd1fdb55500089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500090 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335043:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783947376.335045:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335051:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947376.335054:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335061:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947376.335068:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947376.335078:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947376.335089:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335096:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947376.335100:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335106:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb5550006d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500074 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335133:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947376.335137:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335144:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bc0030e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947376.335147:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335154:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947376.335170:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947376.335177:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947376.335206:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335213:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947376.335222:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335229:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030e00/0xe6fd1fdb5550005f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500066 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335240:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947376.335244:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335251:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bc0030000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947376.335254:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335262:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947376.335269:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947376.335275:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947376.335286:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335292:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947376.335295:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335302:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bc0030000/0xe6fd1fdb55500051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500058 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.335311:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947376.335317:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947376.335319:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947376.335340:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020352:0@lo:103: 00000100:00100000:2.0:1783947376.335389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.335413:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020864:0@lo:103: 00000100:00100000:2.0:1783947376.335431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.335488:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783947376.335495:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020480:0@lo:103: 00000100:00100000:2.0:1783947376.335515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.335533:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020992:0@lo:103: 00000100:00100000:2.0:1783947376.335551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947376.335788:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.335820:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 23 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.335834:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236020224:0@lo:104: 00000100:00100000:3.0:1783947376.335863:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783947376.335906:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.335915:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 23 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.335925:0:10326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236021248:0@lo:104: 00000100:00100000:3.0:1783947376.335945:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947376.335961:0:10326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947376.335984:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019328:0@lo:104: 00000100:00100000:3.0:1783947376.335995:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019456:0@lo:104: 00000100:00100000:3.0:1783947376.336004:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019584:0@lo:104: 00000100:00100000:3.0:1783947376.336012:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019712:0@lo:104: 00000100:00100000:3.0:1783947376.336020:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019840:0@lo:104: 00000100:00100000:3.0:1783947376.336028:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019968:0@lo:104: 00000100:00100000:3.0:1783947376.336035:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236020096:0@lo:104: 00000100:00100000:0.0:1783947376.336736:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236020736:0@lo:103: 00000100:00100000:0.0:1783947376.336794:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020224 00000100:00100000:0.0:1783947376.336801:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020224 00000100:00100000:0.0:1783947376.336842:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236021248 00000100:00100000:0.0:1783947376.336846:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236021248 00000100:00100000:0.0:1783947376.336859:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947376.336867:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:10326:x1870604236020224:12345-0@lo:104: 00010000:00010000:0.0:1783947376.336885:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.336944:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947376.336950:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:10326:x1870604236020224:12345-0@lo:104: Request processed in 84us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.336959:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947376.336975:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947376.336981:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:10326:x1870604236021248:12345-0@lo:104: 00010000:00010000:0.0:1783947376.336989:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337015:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783947376.337021:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:10326:x1870604236021248:12345-0@lo:104: Request processed in 40us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.337027:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947376.337052:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020352 00000100:00100000:0.0:1783947376.337055:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020352 00010000:00010000:0.0:1783947376.337075:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 24 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947376.337113:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020864 00000100:00100000:0.0:1783947376.337116:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020864 00010000:00010000:0.0:1783947376.337140:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 25 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947376.337151:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020480 00000100:00100000:0.0:1783947376.337153:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020480 00010000:00010000:0.0:1783947376.337164:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 26 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947376.337172:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020992 00000100:00100000:0.0:1783947376.337175:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020992 00010000:00010000:0.0:1783947376.337183:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 27 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947376.337194:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947376.337198:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+27:3637:x1870604236020352:12345-0@lo:103: 00010000:00010000:0.0:1783947376.337208:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947376.337213:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 27 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337222:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 27 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337239:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c02052e00/0xe6fd1fdb55500100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555000f9 expref: 27 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337257:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947376.337282:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc649ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+26:3637:x1870604236020352:12345-0@lo:103: Request processed in 83us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.337299:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947376.337365:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947376.337372:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+25:3637:x1870604236020864:12345-0@lo:103: 00010000:00010000:0.0:1783947376.337379:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947376.337384:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 25 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337392:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 25 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337403:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda96400/0xe6fd1fdb55500074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550006d expref: 25 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337415:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947376.337797:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236020864:12345-0@lo:103: Request processed in 424us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.337804:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947376.337818:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947376.337826:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3637:x1870604236020480:12345-0@lo:103: 00010000:00010000:0.0:1783947376.337834:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947376.337839:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337849:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337861:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555000d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555000cf expref: 23 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.337883:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947376.338189:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020352:0@lo:103: 00000100:00100000:2.0:1783947376.338201:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020864:0@lo:103: 00000100:00100000:2.0:1783947376.338238:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236020608:0@lo:103: 00000100:00100000:2.0:1783947376.338272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.338283:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236021120:0@lo:103: 00000100:00100000:2.0:1783947376.338297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.338320:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020608 00000100:00100000:2.0:1783947376.338325:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020608 00010000:00010000:2.0:1783947376.338346:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 23 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947376.338361:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236021120 00000100:00100000:2.0:1783947376.338364:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236021120 00010000:00010000:2.0:1783947376.338373:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 24 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947376.338398:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947376.338403:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236020992:12345-0@lo:103: 00010000:00010000:2.0:1783947376.338411:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947376.338415:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 24 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338424:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 24 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338452:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c2200/0xe6fd1fdb55500066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550005f expref: 24 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338486:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947376.338528:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3637:x1870604236020992:12345-0@lo:103: Request processed in 124us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.338534:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947376.338547:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947376.338552:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3639:x1870604236020608:12345-0@lo:103: 00010000:00010000:2.0:1783947376.338571:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947376.338575:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 22 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338584:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 22 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338594:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97000/0xe6fd1fdb555000ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555000b3 expref: 22 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338614:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947376.338640:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3639:x1870604236020608:12345-0@lo:103: Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.338645:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947376.338658:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947376.338664:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3639:x1870604236021120:12345-0@lo:103: 00010000:00010000:2.0:1783947376.338672:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947376.338676:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 20 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338684:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 20 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338693:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c2e00/0xe6fd1fdb55500058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55500051 expref: 20 pid: 6505 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947376.338701:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947376.338721:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:3639:x1870604236021120:12345-0@lo:103: Request processed in 57us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.338727:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947376.338755:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7144700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236020608:0@lo:103: 00000100:00100000:2.0:1783947376.338763:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236021120:0@lo:103: 00000100:00100000:2.0:1783947376.338793:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020992:0@lo:103: 00000100:00100000:0.0:1783947376.339349:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:3637:x1870604236020480:12345-0@lo:103: Request processed in 1522us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.339358:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783947376.339395:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947376.339473:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236020736 00000100:00100000:0.0:1783947376.339479:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236020736 00010000:00010000:0.0:1783947376.339501:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 18 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947376.339745:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947376.339753:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:3640:x1870604236020736:12345-0@lo:103: 00010000:00010000:0.0:1783947376.339764:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947376.339770:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 18 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.339781:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 18 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.339796:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c3a00/0xe6fd1fdb55500090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55500089 expref: 18 pid: 6503 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.339811:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947376.339844:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3640:x1870604236020736:12345-0@lo:103: Request processed in 93us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.339852:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947376.339883:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236020736:0@lo:103: 00010000:00010000:0.0:1783947376.339907:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947376.339926:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.339935:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bc0031e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947376.339940:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.339950:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947376.339959:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947376.339965:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947376.339997:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340004:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947376.340023:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340030:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031e00/0xe6fd1fdb55500012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500019 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340045:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947376.340049:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340055:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947376.340058:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340077:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947376.340084:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947376.340091:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783947376.340103:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340109:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947376.340120:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340139:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e600/0xe6fd1fdb554fffe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554fffef expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340154:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947376.340156:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947376.340158:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947376.340170:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236021376:0@lo:103: 00000100:00100000:0.0:1783947376.340209:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947376.340234:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947376.340242:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236021504:0@lo:103: 00000100:00100000:0.0:1783947376.340265:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947376.340287:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236021376 00000100:00100000:0.0:1783947376.340292:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236021376 00010000:00010000:0.0:1783947376.340308:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 17 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947376.340692:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236021504 00000100:00100000:0.0:1783947376.340696:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236021504 00010000:00010000:0.0:1783947376.340711:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 18 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947376.340726:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947376.340733:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc6499c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:3640:x1870604236021376:12345-0@lo:103: 00010000:00010000:0.0:1783947376.340743:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947376.340747:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 18 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340756:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 18 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340770:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947376.340803:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc6499c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:3640:x1870604236021376:12345-0@lo:103: Request processed in 70us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.340823:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947376.340862:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947376.340869:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3638:x1870604236021504:12345-0@lo:103: 00010000:00010000:0.0:1783947376.340876:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947376.340881:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 17 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340889:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 17 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.340899:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947376.340930:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:3638:x1870604236021504:12345-0@lo:103: Request processed in 61us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.340937:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947376.340973:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236021376:0@lo:103: 00000100:00100000:0.0:1783947376.340994:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236021504:0@lo:103: 00000100:00100000:2.0:1783947376.341138:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236020480:0@lo:103: 00010000:00010000:3.0:1783947376.341416:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e200/0xe6fd1fdb55500019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55500012 expref: 16 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.341430:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236020224:0@lo:104: 00010000:00010000:2.0:1783947376.341576:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947376.341593:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947376.341818:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bc0030400/0xe6fd1fdb554fffef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554fffe8 expref: 15 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.341829:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236021248:0@lo:104: 00000100:00100000:3.0:1783947376.347846:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019072:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947376.347866:0:10326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1870604236019200:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947376.347937:0:10326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947376.348585:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947376.348653:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949056 00000100:00100000:1.0:1783947376.348663:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949056 00010000:00010000:1.0:1783947376.348711:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 10 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947376.348778:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:1.0:1783947376.348789:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2406:x1870604213949056:12345-192.168.204.3@tcp:103: 00010000:00010000:1.0:1783947376.348808:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947376.348815:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 10 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.348828:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 10 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.348847:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a400/0xe6fd1fdb55500115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d27 expref: 10 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.348864:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947376.348938:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:2406:x1870604213949056:12345-192.168.204.3@tcp:103: Request processed in 150us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947376.348945:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:1.0:1783947376.355238:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947376.358186:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949184 00000100:00100000:0.0:1783947376.358209:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949184 00010000:00010000:1.0:1783947376.358569:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 9 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947376.358618:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:1.0:1783947376.358629:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:2407:x1870604213949184:12345-192.168.204.3@tcp:103: 00010000:00010000:1.0:1783947376.358648:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947376.358655:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 9 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358694:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 9 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358714:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439200/0xe6fd1fdb5550010e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d20 expref: 9 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358733:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358742:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358761:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358768:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358775:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358780:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358784:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947376.358788:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358794:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358818:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947376.358830:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947376.358921:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:2407:x1870604213949184:12345-192.168.204.3@tcp:103: Request processed in 293us (3698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947376.358929:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00010000:00010000:3.0:1783947376.360600:0:10326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.360621:0:10326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947376.360629:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500154 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947376.820131:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947376.883888:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236021632:0@lo:13: 00000100:00100000:0.0:1783947376.883982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947376.884400:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236021632 00000100:00100000:2.0:1783947376.884410:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236021632 00000100:00100000:2.0:1783947376.884502:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947376.884514:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236021632:12345-0@lo:13: 00002000:00000024:2.0:1783947376.884549:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947376.884603:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236021632:12345-0@lo:13: Request processed in 93us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947376.884611:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783947376.884701:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236021760:0@lo:13: 00000100:00100000:0.0:1783947376.884731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947376.884773:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236021760 00000100:00100000:0.0:1783947376.884777:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236021760 00000100:00100000:0.0:1783947376.884802:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947376.884809:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236021760:12345-0@lo:13: 00002000:00000024:0.0:1783947376.884820:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947376.884852:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236021760:12345-0@lo:13: Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947376.884858:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783947376.884893:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6408000 x1870604236021760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947376.884914:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236021760:0@lo:13: 00010000:00080000:0.0:1783947376.884950:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9c00 x1870604236021632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947376.884962:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236021632:0@lo:13: 00000100:00080000:1.0:1783947376.885145:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947377.402527:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947377.409833:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236021888:0@lo:41: 00000100:00100000:1.0:1783947377.409949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.411618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236021888 00000100:00100000:3.0:1783947377.411651:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236021888 00000100:00100000:3.0:1783947377.411772:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947377.411800:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236021888:12345-0@lo:41: 00000004:00000024:3.0:1783947377.411869:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947377.411974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236021888:12345-0@lo:41: Request processed in 177us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.411982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783947377.413380:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236021888:0@lo:41: 00010000:00010000:2.0:1783947377.844404:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783947377.845361:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783947377.845368:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc47c2000 from 48 10000000:01000000:0.0:1783947377.845374:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947377.845441:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.845476:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.845490:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947377.845525:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022016:0@lo:101: 00000100:00100000:0.0:1783947377.845619:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.845826:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022016 00000100:00100000:3.0:1783947377.845854:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022016 00000100:00100000:3.0:1783947377.845931:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783947377.845942:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+15:6507:x1870604236022016:12345-0@lo:101: 00010000:00010000:3.0:1783947377.845958:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947377.845974:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550015b expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.846005:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550015b expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.846018:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550015b expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.846028:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97e00, rc 0) 00000100:00100000:3.0:1783947377.846070:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236022016:12345-0@lo:101: Request processed in 131us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.846078:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783947377.846372:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac76830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.846402:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022016:0@lo:101: 00010000:00010000:0.0:1783947377.846417:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.846427:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947377.846527:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022144:0@lo:501: 00000100:00100000:0.0:1783947377.846558:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.846663:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022144 00000100:00100000:3.0:1783947377.846669:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022144 00000100:00100000:3.0:1783947377.846701:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1783947377.846709:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236022144:12345-0@lo:501: 00000100:00100000:3.0:1783947377.846862:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236022144:12345-0@lo:501: Request processed in 153us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.846870:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783947377.852016:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac76830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.852083:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022144:0@lo:501: 00000100:00100000:0.0:1783947377.852180:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022272:0@lo:503: 00000100:00100000:0.0:1783947377.852301:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.852433:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac76830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.852628:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022272 00000100:00100000:2.0:1783947377.852636:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022272 00000100:00100000:2.0:1783947377.853009:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783947377.853021:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236022272:12345-0@lo:503: 00000100:00100000:2.0:1783947377.853208:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236022272:12345-0@lo:503: Request processed in 189us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.853215:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1783947377.853316:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022272:0@lo:503: 00000100:00100000:2.0:1783947377.856422:0:10343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10343:1870604236022400:0@lo:502: 00000100:00100000:2.0:1783947377.856561:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.856667:0:10343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.856774:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022400 00000100:00100000:1.0:1783947377.856782:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022400 00000100:00100000:1.0:1783947377.856846:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783947377.856857:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:10343:x1870604236022400:12345-0@lo:502: 00000100:00100000:1.0:1783947377.857361:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:10343:x1870604236022400:12345-0@lo:502: Request processed in 504us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.857370:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1783947377.857486:0:10343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10343:1870604236022400:0@lo:502: 00000100:00100000:2.0:1783947377.857532:0:10343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10343:1870604236022528:0@lo:502: 00000100:00100000:2.0:1783947377.857562:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.857594:0:10343:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645df00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.857618:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022528 00000100:00100000:0.0:1783947377.857625:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022528 00000100:00100000:0.0:1783947377.857733:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783947377.857743:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:10343:x1870604236022528:12345-0@lo:502: 00000100:00100000:0.0:1783947377.857837:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:10343:x1870604236022528:12345-0@lo:502: Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947377.857844:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783947377.857989:0:10343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10343:1870604236022528:0@lo:502: 00000040:00080000:2.0:1783947377.858289:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783947377.858581:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783947377.858602:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947377.858612:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.858621:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947377.858630:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783947377.858632:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1783947377.858634:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783947377.858718:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.858725:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.858735:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947377.858751:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022656:0@lo:101: 00000100:00100000:0.0:1783947377.858805:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.858843:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.858891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022656 00000100:00100000:2.0:1783947377.858898:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022656 00000100:00100000:2.0:1783947377.858947:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1783947377.858955:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+16:6507:x1870604236022656:12345-0@lo:101: 00010000:00010000:2.0:1783947377.858967:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947377.858982:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5fe00/0xe6fd1fdb55500170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500169 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.859009:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5fe00/0xe6fd1fdb55500170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500169 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.859020:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5fe00/0xe6fd1fdb55500170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500169 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.859028:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5fe00, rc 0) 00000100:00100000:2.0:1783947377.859177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236022656:12345-0@lo:101: Request processed in 223us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.859184:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783947377.859414:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022656:0@lo:101: 00010000:00010000:0.0:1783947377.859578:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.859589:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947377.859654:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022784:0@lo:501: 00000100:00100000:0.0:1783947377.859685:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.859770:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.859827:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022784 00000100:00100000:1.0:1783947377.859833:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022784 00000100:00100000:2.0:1783947377.860031:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783947377.860043:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236022784:12345-0@lo:501: 00000100:00100000:0.0:1783947377.860375:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022784:0@lo:501: 00000100:00100000:0.0:1783947377.860406:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022912:0@lo:503: 00000100:00100000:0.0:1783947377.860488:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.860500:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.860543:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236022784:12345-0@lo:501: Request processed in 169us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.860550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783947377.860573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236022912 00000100:00100000:2.0:1783947377.860576:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236022912 00000100:00100000:2.0:1783947377.860604:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783947377.860613:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236022912:12345-0@lo:503: 00000100:00100000:2.0:1783947377.860698:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236022912:12345-0@lo:503: Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.860712:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783947377.860785:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236022912:0@lo:503: 00000100:00100000:1.0:1783947377.861767:0:10344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10344:1870604236023040:0@lo:502: 00000100:00100000:1.0:1783947377.861825:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.861871:0:10344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.861961:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023040 00000100:00100000:0.0:1783947377.861968:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023040 00000100:00100000:0.0:1783947377.862017:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783947377.862026:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:10344:x1870604236023040:12345-0@lo:502: 00000100:00100000:0.0:1783947377.862167:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:10344:x1870604236023040:12345-0@lo:502: Request processed in 142us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947377.862174:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783947377.862412:0:10344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10344:1870604236023040:0@lo:502: 00000020:01000000:1.0:1783947377.862591:0:10344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947377.862609:0:10344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947377.862611:0:10344:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783947377.862619:0:10344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783947377.862649:0:10344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10344:1870604236023168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947377.862687:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.862722:0:10344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.863057:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023168 00000100:00100000:3.0:1783947377.863064:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023168 00000100:00100000:3.0:1783947377.863113:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783947377.863122:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:10344:x1870604236023168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.863399:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:10344:x1870604236023168:12345-0@lo:502:llog_process_th.0 Request processed in 277us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.863413:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783947377.865122:0:10344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10344:1870604236023168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947377.865185:0:10344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947377.865195:0:10344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947377.865198:0:10344:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783947377.865203:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1783947377.865718:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1783947377.865757:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783947377.865782:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.865795:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947377.865808:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783947377.865816:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bff958800 from 48 10000000:01000000:0.0:1783947377.865819:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947377.865863:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.865871:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.865884:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947377.865909:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.865983:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.866034:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.866091:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023296 00000100:00100000:2.0:1783947377.866108:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023296 00000100:00100000:2.0:1783947377.866170:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1783947377.866181:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+17:6507:x1870604236023296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947377.866195:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947377.866210:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5fa00/0xe6fd1fdb5550017e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500177 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.866256:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5fa00/0xe6fd1fdb5550017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500177 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.866268:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5fa00/0xe6fd1fdb5550017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500177 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.866278:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5fa00, rc 0) 00000100:00100000:2.0:1783947377.866341:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236023296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.866348:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783947377.866878:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947377.866897:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.866908:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947377.866976:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.867021:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.867055:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.867117:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023424 00000100:00100000:2.0:1783947377.867121:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023424 00000100:00100000:2.0:1783947377.867159:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783947377.867167:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236023424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.867330:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236023424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.867337:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1783947377.867771:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.867806:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.867852:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.867872:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.867925:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023552 00000100:00100000:1.0:1783947377.867929:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023552 00000100:00100000:1.0:1783947377.867965:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1783947377.867973:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236023552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.868066:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236023552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.868073:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783947377.869582:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.870200:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10345:1870604236023680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.870666:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.870763:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.870879:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023680 00000100:00100000:1.0:1783947377.870887:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023680 00000100:00100000:1.0:1783947377.870996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1783947377.871008:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:10345:x1870604236023680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947377.871179:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:10345:x1870604236023680:12345-0@lo:502:llog_process_th.0 Request processed in 173us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.871188:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1783947377.871300:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10345:1870604236023680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.871353:0:10345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10345:1870604236023808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.871389:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.871739:0:10345:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.871818:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023808 00000100:00100000:3.0:1783947377.871824:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023808 00000100:00100000:3.0:1783947377.871856:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783947377.871864:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:10345:x1870604236023808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.872015:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:10345:x1870604236023808:12345-0@lo:502:llog_process_th.0 Request processed in 151us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.872022:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783947377.872139:0:10345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10345:1870604236023808:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783947377.872162:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783947377.872663:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783947377.872698:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947377.872709:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.872721:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947377.872731:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783947377.872734:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1783947377.872737:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783947377.872894:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.872903:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.872915:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947377.872936:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.872978:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.873156:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d480 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.873193:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236023936 00000100:00100000:3.0:1783947377.873199:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236023936 00000100:00100000:3.0:1783947377.873411:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783947377.873420:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+18:6507:x1870604236023936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947377.873613:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947377.873631:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb5550018c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500185 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.873659:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb5550018c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500185 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.873670:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb5550018c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500185 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.873679:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97a00, rc 0) 00000100:00100000:3.0:1783947377.873776:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236023936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 357us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.873784:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783947377.874847:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236023936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947377.874884:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.874897:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947377.874997:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.875066:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.875124:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.875229:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024064 00000100:00100000:1.0:1783947377.875237:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024064 00000100:00100000:1.0:1783947377.875308:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783947377.875325:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236024064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.876009:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236024064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 684us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.876019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783947377.876142:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.876185:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.876412:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.876677:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.876706:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024192 00000100:00100000:1.0:1783947377.876712:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024192 00000100:00100000:1.0:1783947377.876856:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783947377.876866:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236024192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.876990:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236024192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.876997:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783947377.877069:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.878608:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10346:1870604236024320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947377.878692:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.879198:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.879974:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024320 00000100:00100000:3.0:1783947377.880000:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024320 00000100:00100000:3.0:1783947377.880069:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783947377.880078:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:10346:x1870604236024320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.880293:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:10346:x1870604236024320:12345-0@lo:502:llog_process_th.0 Request processed in 215us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.880301:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783947377.880337:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10346:1870604236024320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947377.880376:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947377.880385:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947377.880387:0:10346:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783947377.880393:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783947377.880438:0:10346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10346:1870604236024448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947377.880509:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.880532:0:10346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.880592:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024448 00000100:00100000:3.0:1783947377.880596:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024448 00000100:00100000:3.0:1783947377.880729:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783947377.880736:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:10346:x1870604236024448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.880828:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:10346:x1870604236024448:12345-0@lo:502:llog_process_th.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.880835:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783947377.880850:0:10346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10346:1870604236024448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947377.880874:0:10346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947377.880879:0:10346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947377.880880:0:10346:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783947377.880884:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1783947377.881083:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1783947377.881124:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783947377.881138:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.881149:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947377.881159:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783947377.881162:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7be784d800 from 48 10000000:01000000:1.0:1783947377.881165:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947377.881193:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.881202:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.881212:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947377.881359:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.882062:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.882159:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.882408:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024576 00000100:00100000:0.0:1783947377.882417:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024576 00000100:00100000:2.0:1783947377.882630:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783947377.882642:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:6507:x1870604236024576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947377.882672:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947377.882691:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb5550019a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500193 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.882721:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb5550019a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500193 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.882734:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb5550019a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500193 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.882753:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e400, rc 0) 00000100:00100000:2.0:1783947377.882812:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236024576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.882819:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783947377.882905:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947377.882923:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.882935:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947377.883012:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.883045:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.883064:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.883179:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024704 00000100:00100000:3.0:1783947377.883184:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024704 00000100:00100000:3.0:1783947377.883228:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783947377.883237:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236024704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947377.883838:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236024704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 600us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.883846:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783947377.883966:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.884008:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.884061:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.884108:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.884153:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024832 00000100:00100000:2.0:1783947377.884158:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024832 00000100:00100000:2.0:1783947377.884198:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783947377.884206:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236024832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.884731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236024832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 525us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.884750:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783947377.885380:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236024832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.886905:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10347:1870604236024960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947377.886998:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.887106:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645db40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.887149:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236024960 00000100:00100000:3.0:1783947377.887156:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236024960 00000100:00100000:3.0:1783947377.887361:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1783947377.887372:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:10347:x1870604236024960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.887755:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:10347:x1870604236024960:12345-0@lo:502:llog_process_th.0 Request processed in 384us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.887774:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783947377.888984:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10347:1870604236024960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.889082:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10347:1870604236025088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.889161:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.889359:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.889421:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025088 00000100:00100000:3.0:1783947377.889558:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025088 00000100:00100000:3.0:1783947377.889618:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783947377.889627:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:10347:x1870604236025088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.889838:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:10347:x1870604236025088:12345-0@lo:502:llog_process_th.0 Request processed in 211us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.889845:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783947377.889939:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10347:1870604236025088:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783947377.889964:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783947377.890175:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783947377.890203:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947377.890215:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.890239:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947377.890258:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783947377.890260:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1783947377.890264:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783947377.890298:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.890320:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.890331:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947377.890350:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.890385:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.890412:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.890689:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025216 00000100:00100000:0.0:1783947377.890694:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025216 00000100:00100000:0.0:1783947377.890726:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783947377.890734:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236025216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947377.890757:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947377.890774:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb555001a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555001a1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.890799:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb555001a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555001a1 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.890811:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb555001a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001a1 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.890820:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b400, rc 0) 00000100:00100000:0.0:1783947377.890863:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236025216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947377.890869:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783947377.890936:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947377.890950:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.890960:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947377.891015:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.891041:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.891065:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.891152:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025344 00000100:00100000:0.0:1783947377.891156:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025344 00000100:00100000:0.0:1783947377.891183:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783947377.891189:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236025344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.891355:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236025344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947377.891362:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783947377.891551:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.891580:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.891621:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.891637:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.891737:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025472 00000100:00100000:0.0:1783947377.891751:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025472 00000100:00100000:0.0:1783947377.891773:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783947377.891779:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236025472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947377.892024:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236025472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947377.892032:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783947377.892199:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.893069:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10348:1870604236025600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947377.893142:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.893182:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1588b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.893367:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025600 00000100:00100000:3.0:1783947377.893374:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025600 00000100:00100000:3.0:1783947377.893477:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783947377.893488:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10348:x1870604236025600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.893622:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10348:x1870604236025600:12345-0@lo:502:llog_process_th.0 Request processed in 136us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.893629:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783947377.893915:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10348:1870604236025600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947377.893955:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947377.893965:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947377.893967:0:10348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783947377.893974:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783947377.894006:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10348:1870604236025728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947377.894048:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.894185:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.894384:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025728 00000100:00100000:2.0:1783947377.894390:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025728 00000100:00100000:2.0:1783947377.894422:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783947377.894443:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10348:x1870604236025728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947377.894580:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10348:x1870604236025728:12345-0@lo:502:llog_process_th.0 Request processed in 138us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947377.894588:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783947377.894689:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10348:1870604236025728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947377.894711:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947377.894716:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947377.894718:0:10348:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783947377.894723:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1783947377.895003:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1783947377.895028:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783947377.895038:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.895050:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947377.895060:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783947377.895062:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc9511800 from 48 10000000:01000000:2.0:1783947377.895065:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947377.895103:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.895112:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.895122:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947377.895138:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.895171:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.895210:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.895893:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025856 00000100:00100000:1.0:1783947377.895901:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025856 00000100:00100000:1.0:1783947377.895940:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783947377.895948:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236025856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947377.895963:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947377.895981:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438800/0xe6fd1fdb555001b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555001af expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.896007:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438800/0xe6fd1fdb555001b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555001af expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.896019:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438800/0xe6fd1fdb555001b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001af expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.896029:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438800, rc 0) 00000100:00100000:1.0:1783947377.896073:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236025856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.896089:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783947377.896283:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947377.896298:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947377.896308:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947377.896369:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.896396:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.896433:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.896583:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236025984 00000100:00100000:1.0:1783947377.896588:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236025984 00000100:00100000:1.0:1783947377.896610:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783947377.896616:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236025984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.896754:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236025984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.896762:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1783947377.896962:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236025984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.896992:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.897036:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.897052:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.897164:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236026112 00000100:00100000:3.0:1783947377.897169:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236026112 00000100:00100000:3.0:1783947377.897203:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1783947377.897210:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236026112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947377.897401:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236026112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.897409:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783947377.897522:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.898863:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10349:1870604236026240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947377.898931:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947377.898975:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.899032:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236026240 00000100:00100000:3.0:1783947377.899040:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236026240 00000100:00100000:3.0:1783947377.899083:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783947377.899101:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10349:x1870604236026240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.899244:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10349:x1870604236026240:12345-0@lo:502:llog_process_th.0 Request processed in 154us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.899259:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1783947377.899407:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10349:1870604236026240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.899492:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10349:1870604236026368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.899528:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947377.899554:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.900060:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236026368 00000100:00100000:3.0:1783947377.900066:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236026368 00000100:00100000:3.0:1783947377.900118:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783947377.900126:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10349:x1870604236026368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.900220:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10349:x1870604236026368:12345-0@lo:502:llog_process_th.0 Request processed in 96us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.900227:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783947377.900483:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10349:1870604236026368:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783947377.900509:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783947377.900775:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783947377.900804:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783947377.900815:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.900826:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947377.900835:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783947377.900838:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1783947377.900841:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783947377.900876:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.900884:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.900895:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947377.900923:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947377.900960:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.900995:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.901099:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236026496 00000100:00100000:0.0:1783947377.901105:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236026496 00000100:00100000:0.0:1783947377.901145:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1783947377.901152:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236026496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947377.901164:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947377.901179:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb555001c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555001bd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.901658:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb555001c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555001bd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.901673:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb555001c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001bd expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947377.901683:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a200, rc 0) 00000100:00100000:0.0:1783947377.901961:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236026496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 808us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947377.901969:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783947377.902039:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947377.902055:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.902066:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947377.902143:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947377.902172:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.902266:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.902416:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236026624 00000100:00100000:1.0:1783947377.902422:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236026624 00000100:00100000:1.0:1783947377.902692:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783947377.902702:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236026624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.902894:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236026624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.902903:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783947377.902976:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.903021:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.903075:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.903255:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947377.903401:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236026752 00000100:00100000:3.0:1783947377.903406:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236026752 00000100:00100000:3.0:1783947377.903445:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783947377.903453:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236026752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947377.903609:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236026752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.903616:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783947377.903758:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236026752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947377.904670:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10350:1870604236026880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947377.904730:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.904823:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236026880 00000100:00100000:3.0:1783947377.904829:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236026880 00000100:00100000:3.0:1783947377.904874:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783947377.904882:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10350:x1870604236026880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947377.905186:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10350:x1870604236026880:12345-0@lo:502:llog_process_th.0 Request processed in 304us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947377.905200:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783947377.905417:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947377.905685:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10350:1870604236026880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947377.905718:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947377.905729:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947377.905732:0:10350:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783947377.905907:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783947377.905948:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10350:1870604236027008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947377.905992:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947377.906062:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947377.906109:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027008 00000100:00100000:0.0:1783947377.906116:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027008 00000100:00100000:0.0:1783947377.906199:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783947377.906209:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10350:x1870604236027008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947377.906364:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10350:x1870604236027008:12345-0@lo:502:llog_process_th.0 Request processed in 156us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947377.906371:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783947377.906448:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10350:1870604236027008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947377.906499:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947377.906504:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947377.906506:0:10350:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783947377.906516:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783947377.906927:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1783947377.906954:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783947377.906967:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.906978:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947377.906989:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783947377.906991:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e7bc5510000 from 1 10000000:01000000:3.0:1783947377.906994:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783947377.907025:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.907033:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.907045:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947377.907063:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236027136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947377.907110:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.907399:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.907683:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027136 00000100:00100000:1.0:1783947377.907689:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027136 00000100:00100000:1.0:1783947377.907731:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783947377.907739:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236027136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947377.907754:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947377.907773:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb555001d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555001cb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.907819:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb555001d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555001cb expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.907830:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb555001d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001cb expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947377.907840:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438a00, rc 0) 00000100:00100000:1.0:1783947377.907879:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236027136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947377.907886:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783947377.908005:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236027136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947377.908022:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001d2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.908044:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001d2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947377.908126:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236027264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947377.908153:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947377.908184:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c780 going to sleep for 11 seconds 00000100:00100000:1.0:1783947377.908452:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027264 00000100:00100000:1.0:1783947377.908488:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027264 00000100:00100000:1.0:1783947377.908510:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783947377.908516:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236027264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947377.908601:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236027264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (447us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947377.908609:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783947377.908713:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236027264:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783947377.908742:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783947377.908750:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001d2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947377.908757:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001d2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947378.156971:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947378.157143:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949312 00000100:00100000:1.0:1783947378.157157:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949312 00000100:00100000:1.0:1783947378.157233:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:1.0:1783947378.157245:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:6179:x1870604213949312:12345-192.168.204.3@tcp:101: 00010000:00010000:1.0:1783947378.157266:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947378.157289:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438200/0xe6fd1fdb555001d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3d97 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947378.157325:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438200/0xe6fd1fdb555001d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d97 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947378.157371:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438200/0xe6fd1fdb555001d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d97 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947378.157381:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438200, rc 0) 00000100:00100000:1.0:1783947378.157530:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6179:x1870604213949312:12345-192.168.204.3@tcp:101: Request processed in 288us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947378.157538:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:2.0:1783947378.164934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947378.165032:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949440 00000100:00100000:3.0:1783947378.165046:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949440 00000100:00100000:3.0:1783947378.165130:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:3.0:1783947378.165142:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6179:x1870604213949440:12345-192.168.204.3@tcp:501: 00000100:00100000:3.0:1783947378.165395:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6179:x1870604213949440:12345-192.168.204.3@tcp:501: Request processed in 254us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947378.165404:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:3.0:1783947378.168993:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947378.173872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949568 00000100:00100000:0.0:1783947378.173893:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949568 00000100:00100000:0.0:1783947378.174539:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:0.0:1783947378.174552:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6179:x1870604213949568:12345-192.168.204.3@tcp:503: 00000100:00100000:0.0:1783947378.175177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6179:x1870604213949568:12345-192.168.204.3@tcp:503: Request processed in 624us (6198us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.175187:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:2.0:1783947378.181108:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947378.184548:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949696 00000100:00100000:1.0:1783947378.184570:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949696 00000100:00100000:1.0:1783947378.184849:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:1.0:1783947378.184863:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6660:x1870604213949696:12345-192.168.204.3@tcp:502: 00000100:00100000:1.0:1783947378.185803:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6660:x1870604213949696:12345-192.168.204.3@tcp:502: Request processed in 936us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947378.185816:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:2.0:1783947378.192314:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947378.192784:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949824 00000100:00100000:0.0:1783947378.192795:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949824 00000100:00100000:0.0:1783947378.192881:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:0.0:1783947378.192893:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6660:x1870604213949824:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947378.193105:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6660:x1870604213949824:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 213us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.193114:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:3.0:1783947378.200577:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947378.200790:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213949952 00000100:00100000:1.0:1783947378.200805:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213949952 00000100:00100000:1.0:1783947378.200869:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:1.0:1783947378.200880:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6179:x1870604213949952:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947378.200902:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947378.200935:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439600/0xe6fd1fdb555001e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3d9e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947378.200973:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439600/0xe6fd1fdb555001e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d9e expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947378.200988:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439600/0xe6fd1fdb555001e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d9e expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947378.201017:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439600, rc 0) 00000100:00100000:1.0:1783947378.201101:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213949952:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 223us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947378.201109:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:2.0:1783947378.206042:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947378.206226:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950080 00000100:00100000:3.0:1783947378.206267:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950080 00000100:00100000:3.0:1783947378.206338:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 246 00000100:00100000:3.0:1783947378.206349:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213950080:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947378.206552:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213950080:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 204us (523us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947378.206560:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 246 00000100:00100000:3.0:1783947378.419859:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236027392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947378.419978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947378.420063:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027392 00000100:00100000:2.0:1783947378.420092:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027392 00000100:00080000:1.0:1783947378.420178:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947378.420217:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236027520:0@lo:400:kworker.0 00000100:00100000:2.0:1783947378.420258:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947378.420271:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236027392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947378.420279:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1783947378.420314:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947378.420346:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027520 00000100:00100000:1.0:1783947378.420352:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027520 00000100:00100000:1.0:1783947378.420395:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947378.420414:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236027520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947378.420488:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236027520:12345-0@lo:400:kworker.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947378.420497:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947378.420554:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236027520:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.421725:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236027776:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.421787:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.421819:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236028288:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.421848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.421864:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236028800:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.421884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.421929:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783947378.421936:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236027648:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.421963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.421983:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236028160:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.422004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.422018:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236028672:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.422037:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.422068:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027776 00000100:00100000:0.0:1783947378.422075:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027776 00000100:00100000:0.0:1783947378.422129:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028160 00000100:00100000:0.0:1783947378.422133:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028160 00000100:00100000:0.0:1783947378.422154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028672 00000100:00100000:0.0:1783947378.422158:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028672 00000100:00100000:0.0:1783947378.422174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783947378.422195:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236027776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.422296:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236027776:12345-0@lo:400:kworker.0 Request processed in 103us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.422304:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783947378.423005:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783947378.423019:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236028160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.423067:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236028160:12345-0@lo:400:kworker.0 Request processed in 55us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.423073:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783947378.423098:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783947378.423105:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236028672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947378.423217:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028288 00000100:00100000:1.0:1783947378.423230:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028288 00010000:00080000:3.0:1783947378.423258:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640aa00 x1870604236027392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947378.423281:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028800 00000100:00100000:1.0:1783947378.423284:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028800 00000100:00100000:3.0:1783947378.423287:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236027392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947378.423307:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947378.423312:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236027904:0@lo:400:kworker.0 00000100:00100000:1.0:1783947378.423314:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236028288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947378.423323:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236027392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3052us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947378.423334:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947378.423379:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947378.423388:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236028800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.423620:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236028672:12345-0@lo:400:kworker.0 Request processed in 514us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.423626:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783947378.423631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947378.423647:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947378.423651:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947378.423654:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947378.423660:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236028416:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.423675:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236028032:0@lo:400:kworker.0 00000100:00100000:3.0:1783947378.423698:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.423700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947378.423850:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027648 00000100:00100000:3.0:1783947378.423855:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027648 00000100:00100000:3.0:1783947378.423885:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236027904 00000100:00100000:3.0:1783947378.423888:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236027904 00000100:00100000:3.0:1783947378.423902:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783947378.423908:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236027648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947378.423946:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236027648:12345-0@lo:400:kworker.0 Request processed in 38us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947378.423952:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783947378.423965:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947378.423980:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236027904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947378.424013:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236027904:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.424015:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236028544:0@lo:400:kworker.0 00000100:00100000:3.0:1783947378.424019:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783947378.424039:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947378.424049:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236027904:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.424068:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028032 00000100:00100000:0.0:1783947378.424072:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028032 00000100:00100000:0.0:1783947378.424111:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028544 00000100:00100000:0.0:1783947378.424115:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028544 00000100:00100000:0.0:1783947378.424129:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783947378.424135:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236028032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.424182:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236028032:12345-0@lo:400:kworker.0 Request processed in 47us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.424189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783947378.424202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783947378.424281:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1783947378.424290:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1783947378.424382:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236028544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947378.424561:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236028288:12345-0@lo:400:kworker.0 Request processed in 1247us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947378.424569:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947378.424571:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028416 00000100:00100000:3.0:1783947378.424574:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028416 00000100:00100000:3.0:1783947378.424601:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783947378.424606:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236028416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947378.424644:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236028416:12345-0@lo:400:kworker.0 Request processed in 38us (945us total) trans 0 rc 0/0 00000100:00080000:1.0:1783947378.424649:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947378.424650:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1783947378.424660:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783947378.424675:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5840e00 x1870604236028416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947378.424687:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236027648:0@lo:400:kworker.0 00000100:00100000:3.0:1783947378.424696:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236028416:0@lo:400:kworker.0 00010000:00080000:1.0:1783947378.424700:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb9c00 x1870604236028160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947378.424710:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236028160:0@lo:400:kworker.0 00010000:00080000:1.0:1783947378.424724:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7147100 x1870604236028672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947378.424732:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7147100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236028672:0@lo:400:kworker.0 00000100:00100000:1.0:1783947378.424747:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236027776:0@lo:400:kworker.0 00010000:00080000:1.0:1783947378.424757:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cbad80 x1870604236028288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947378.424766:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236028288:0@lo:400:kworker.0 00000100:00100000:1.0:1783947378.424816:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236028032:0@lo:400:kworker.0 00000100:00100000:2.0:1783947378.424840:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236028800:12345-0@lo:400:kworker.0 Request processed in 1451us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947378.424851:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1783947378.424856:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7146300 x1870604236028800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947378.424868:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236028800:0@lo:400:kworker.0 00000100:00100000:0.0:1783947378.425002:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236028544:12345-0@lo:400:kworker.0 Request processed in 793us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.425009:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947378.425061:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236028544:0@lo:400:kworker.0 00000100:00100000:2.0:1783947378.673927:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947378.674049:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947378.676850:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950464 00000100:00100000:3.0:1783947378.676871:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950464 00000100:00100000:3.0:1783947378.677141:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1783947378.677154:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213950464:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947378.677256:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213950464:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 104us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947378.677265:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00080000:0.0:1783947378.677834:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947378.678166:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947378.683384:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950208 00000100:00100000:1.0:1783947378.683384:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950336 00000100:00100000:2.0:1783947378.683403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950208 00000100:00100000:1.0:1783947378.683404:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950336 00000100:00080000:3.0:1783947378.683557:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947378.683659:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1783947378.683692:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213950208:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947378.683804:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213950208:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 117us (9891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947378.683813:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:0.0:1783947378.683835:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947378.683860:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950592 00000100:00100000:3.0:1783947378.683865:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950592 00000100:00100000:3.0:1783947378.683903:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947378.683909:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213950592:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947378.683935:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213950592:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947378.683941:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00080000:3.0:1783947378.683960:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947378.684249:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:1.0:1783947378.684258:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213950336:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947378.684337:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213950336:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 80us (6174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947378.684355:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00080000:3.0:1783947378.684571:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783947378.867782:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947378.931998:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236028928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947378.932181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947378.932419:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236028928 00000100:00100000:0.0:1783947378.932431:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236028928 00000100:00100000:0.0:1783947378.932528:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947378.932541:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236028928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947378.932570:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947378.932624:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236028928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947378.932631:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1783947378.933133:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640a680 x1870604236028928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947378.933157:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236028928:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1783947379.412449:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed6538f90 20000000:00000080:3.0:1783947379.412622:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7ac7c21c00 uarg=0000000000000000 20000000:01000000:3.0:1783947379.412678:0:10388:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783947379.412685:0:10388:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783947379.412691:0:10388:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783947379.414993:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783947379.415375:0:10388:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1783947379.429420:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1783947379.429506:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1783947379.430236:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1783947379.430270:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783947379.430299:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430322:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5e000/0xe6fd1fdb554ffe83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430332:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430339:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430346:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430357:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430367:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430440:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 9 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.430496:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 9 pid: 6503 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.430514:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029056:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947379.431230:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.431241:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 23 pid: 6504 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.431252:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029184:0@lo:104: 00000100:00100000:2.0:1783947379.431304:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947379.431353:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.431361:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 23 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.431370:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029312:0@lo:104: 00000100:00100000:2.0:1783947379.431397:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947379.431425:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947379.431435:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 23 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.431494:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029440:0@lo:104: 00010000:00010000:2.0:1783947379.431552:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5e000/0xe6fd1fdb554ffe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947379.431563:0:9527:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1783947379.431563:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffa5e000/0xe6fd1fdb554ffe83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 23 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.431587:0:10388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029568:0@lo:104: 00000100:00100000:3.0:1783947379.431632:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947379.431983:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236029184 00000100:00100000:1.0:1783947379.431994:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236029184 00000100:00100000:1.0:1783947379.432046:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236029312 00000100:00100000:1.0:1783947379.432049:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236029312 00000100:00100000:1.0:1783947379.432071:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236029440 00000100:00100000:1.0:1783947379.432074:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236029440 00000100:00100000:1.0:1783947379.432092:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947379.432102:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:10388:x1870604236029184:12345-0@lo:104: 00010000:00010000:1.0:1783947379.432125:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.432178:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947379.432203:0:10388:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947379.432362:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236029568 00000100:00100000:3.0:1783947379.432374:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236029568 00000100:00100000:3.0:1783947379.432436:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947379.432447:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac1712c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:10388:x1870604236029312:12345-0@lo:104: 00010000:00010000:3.0:1783947379.432489:0:9527:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.432608:0:9527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947379.432642:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029312:0@lo:104: 00000100:00100000:3.0:1783947379.432768:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac1712c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:10388:x1870604236029312:12345-0@lo:104: Request processed in 321us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947379.432782:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1783947379.432782:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947379.432799:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:10388:x1870604236029184:12345-0@lo:104: Request processed in 696us (1493us total) trans 0 rc 0/0 00010000:00010000:0.0:1783947379.432801:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783947379.432815:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1783947379.432815:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947379.432829:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1783947379.432832:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c3c00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947379.432842:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947379.432843:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:10388:x1870604236029440:12345-0@lo:104: 00010000:00010000:3.0:1783947379.432864:0:9527:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947379.432891:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1783947379.432905:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947379.432906:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:10388:x1870604236029568:12345-0@lo:104: 10000000:00010000:0.0:1783947379.432921:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.432925:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947379.432927:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947379.432948:0:9527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783947379.432957:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:10388:x1870604236029440:12345-0@lo:104: Request processed in 118us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947379.432966:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1783947379.432983:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.432988:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1783947379.432992:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783947379.433006:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:10388:x1870604236029568:12345-0@lo:104: Request processed in 100us (823us total) trans 0 rc 0/0 00010000:00010000:3.0:1783947379.433014:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1783947379.433021:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1783947379.433024:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.433027:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.433046:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3c00/0xe6fd1fdb554ffede lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffee5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.433051:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f000 already unused, calling callback (ffffffffc11fcc20) 00010000:00010000:1.0:1783947379.433052:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1783947379.433073:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.433085:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.433086:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947379.433096:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947379.433102:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.433107:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bc0031c00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947379.433115:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947379.433121:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783947379.433128:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947379.433144:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947379.433158:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947379.433175:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.433185:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029184:0@lo:104: 00010000:00010000:0.0:1783947379.433185:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.433188:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947379.433200:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783947379.433208:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029440:0@lo:104: 00010000:00010000:0.0:1783947379.433225:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.433227:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947379.433234:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029568:0@lo:104: 00010000:00010000:3.0:1783947379.433253:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f000/0xe6fd1fdb55500004 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550000b expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.433268:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947379.433270:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947379.433272:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947379.433334:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236029824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947379.433345:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bc0031c00/0xe6fd1fdb554ffe7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe83 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947379.433360:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947379.433362:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947379.433368:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947379.433378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947379.433421:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947379.433428:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236029952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947379.433450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947379.433511:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236029824 00000100:00100000:1.0:1783947379.433516:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236029824 00000100:00100000:0.0:1783947379.433654:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236029696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947379.433692:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 24 pid: 6504 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947379.433764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947379.433765:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236029952 00000100:00100000:1.0:1783947379.433770:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236029952 00010000:00010000:1.0:1783947379.433791:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5e000/0xe6fd1fdb554ffe83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 25 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947379.435779:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236029696 00000100:00100000:1.0:1783947379.435798:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236029696 00010000:00010000:1.0:1783947379.435847:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 26 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947379.435889:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947379.435899:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+26:3639:x1870604236029824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947379.435918:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947379.435925:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 26 pid: 6504 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.435958:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 26 pid: 6504 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.435978:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e800/0xe6fd1fdb5550000b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55500004 expref: 26 pid: 6504 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.435999:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947379.436085:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+25:3639:x1870604236029824:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947379.436094:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947379.436114:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947379.436122:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236029952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947379.436130:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947379.436135:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5e000/0xe6fd1fdb554ffe83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 24 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436143:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5e000/0xe6fd1fdb554ffe83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 24 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436153:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e000/0xe6fd1fdb554ffe83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe7c expref: 24 pid: 6503 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436163:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947379.436184:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3639:x1870604236029952:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947379.436191:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947379.436204:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947379.436210:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3638:x1870604236029696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947379.436224:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947379.436229:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 22 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436249:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 22 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436259:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb554ffee5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffede expref: 22 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436268:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947379.436298:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3638:x1870604236029696:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947379.436304:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947379.436367:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236029952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947379.436379:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236029824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947379.436929:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947379.436940:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436950:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947379.436955:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.436965:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947379.436973:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947379.436988:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947379.437034:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.437041:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947379.437075:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.437083:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97800/0xe6fd1fdb554ffe8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb554ffe91 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.437112:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947379.437114:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947379.437115:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947379.437121:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947379.437123:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947379.437501:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236030080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947379.437740:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947379.437818:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236029696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947379.437889:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030080 00000100:00100000:1.0:1783947379.437896:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030080 00010000:00010000:1.0:1783947379.437924:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 21 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947379.437961:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947379.437969:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc6499450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3637:x1870604236030080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947379.437980:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947379.437985:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 21 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.437999:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 21 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.438030:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb554ffe91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb554ffe8a expref: 21 pid: 6505 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.438042:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947379.438088:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc6499450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3637:x1870604236030080:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947379.438096:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783947379.438348:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236030080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947379.443802:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947379.443852:0:10388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1870604236029056:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947379.443919:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947379.446220:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950720 00000100:00100000:3.0:1783947379.446237:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950720 00010000:00010000:3.0:1783947379.446287:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 10 pid: 6503 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947379.446347:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947379.446357:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604213950720:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947379.446374:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947379.446381:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 10 pid: 6503 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446394:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 10 pid: 6503 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446416:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5ec00/0xe6fd1fdb55500123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d5f expref: 10 pid: 6503 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446434:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446476:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446498:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446507:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446514:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446522:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446528:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ea00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947379.446533:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446542:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446571:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.446584:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947379.446654:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:2407:x1870604213950720:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 297us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947379.446664:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00010000:00010000:1.0:1783947379.446670:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.446690:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947379.446699:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb555001e7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947379.894864:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947380.470972:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947380.471007:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236030208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947380.471114:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.471281:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030208 00000100:00100000:1.0:1783947380.471290:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030208 00000100:00100000:1.0:1783947380.471359:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947380.471600:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236030208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947380.471647:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783947380.471749:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236030208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 381us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.471758:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783947380.473170:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236030208:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1783947380.725398:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947380.725407:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc47c2000 from 4 10000000:01000000:3.0:1783947380.725411:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947380.725497:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.725511:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.725643:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947380.725676:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947380.725768:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947380.725833:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947380.725862:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030336 00000100:00100000:3.0:1783947380.725871:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030336 00000100:00100000:3.0:1783947380.725940:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783947380.725951:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236030336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947380.725967:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947380.725985:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555001ee expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.726011:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.726022:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.726033:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7c02053600, rc 0) 00000100:00100000:3.0:1783947380.726095:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236030336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947380.726102:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783947380.726162:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947380.726178:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.726189:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947380.726262:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947380.726289:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947380.727014:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947380.727535:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030464 00000100:00100000:2.0:1783947380.727545:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030464 00000100:00100000:2.0:1783947380.727603:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783947380.727611:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236030464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947380.727790:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236030464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947380.727802:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783947380.727966:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947380.728012:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947380.728068:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947380.728088:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee2300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947380.728100:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030592 00000100:00100000:2.0:1783947380.728104:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030592 00000100:00100000:2.0:1783947380.728127:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783947380.728134:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236030592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947380.728225:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236030592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947380.728232:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783947380.728274:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.744397:0:10452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10452:1870604236030720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.744647:0:10452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.744695:0:10452:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be78319c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947380.744757:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030720 00000100:00100000:3.0:1783947380.744766:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030720 00000100:00100000:3.0:1783947380.744828:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1783947380.744837:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10452:x1870604236030720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947380.744985:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10452:x1870604236030720:12345-0@lo:502:llog_process_th.0 Request processed in 149us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947380.744993:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783947380.745201:0:10452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10452:1870604236030720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947380.745234:0:10452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947380.745246:0:10452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947380.745248:0:10452:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783947380.745256:0:10452:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bc47c2000 00000020:00000080:1.0:1783947380.745259:0:10452:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783947380.745513:0:10452:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10452:1870604236030848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.745723:0:10452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.745752:0:10452:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9d840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947380.745973:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030848 00000100:00100000:3.0:1783947380.745979:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030848 00000100:00100000:3.0:1783947380.746128:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1783947380.746136:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10452:x1870604236030848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947380.746242:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:10452:x1870604236030848:12345-0@lo:502:llog_process_th.0 Request processed in 106us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947380.746249:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1783947380.746341:0:10452:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10452:1870604236030848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947380.746364:0:10452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947380.746371:0:10452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947380.746373:0:10452:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783947380.746378:0:10452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783947380.746690:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783947380.746720:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947380.746731:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.746743:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947380.746754:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947380.746756:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bff958800 from 4 10000000:01000000:3.0:1783947380.746759:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947380.746790:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.746798:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.746808:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947380.746826:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947380.746858:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947380.746895:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.747493:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236030976 00000100:00100000:1.0:1783947380.747502:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236030976 00000100:00100000:1.0:1783947380.747655:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783947380.747664:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236030976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947380.747680:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947380.747697:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555001fc expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.747725:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.747749:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.747760:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438000, rc 0) 00000100:00100000:1.0:1783947380.747812:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236030976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.747820:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783947380.747882:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236030976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947380.747897:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.747908:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947380.747976:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.748003:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.748021:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.748034:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236031104 00000100:00100000:1.0:1783947380.748050:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236031104 00000100:00100000:1.0:1783947380.748071:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783947380.748077:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236031104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.748196:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236031104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.748203:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783947380.748231:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.748267:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.748307:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.748318:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.748330:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236031232 00000100:00100000:1.0:1783947380.748333:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236031232 00000100:00100000:1.0:1783947380.748352:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783947380.748357:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236031232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.748439:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236031232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.749724:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783947380.749844:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.750122:0:10454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10454:1870604236031360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.750183:0:10454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.750215:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236031360 00000100:00100000:1.0:1783947380.750221:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236031360 00000100:00100000:1.0:1783947380.750254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783947380.750263:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10454:x1870604236031360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.750376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10454:x1870604236031360:12345-0@lo:502:llog_process_th.0 Request processed in 113us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.750383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783947380.750414:0:10454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0188a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.750425:0:10454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10454:1870604236031360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947380.750450:0:10454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947380.751214:0:10454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947380.751224:0:10454:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783947380.751234:0:10454:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bff958800 00000020:00000080:1.0:1783947380.751237:0:10454:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783947380.752744:0:10454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10454:1870604236031488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.753408:0:10454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.753473:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236031488 00000100:00100000:1.0:1783947380.753997:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236031488 00000100:00100000:1.0:1783947380.754067:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783947380.754077:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10454:x1870604236031488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.754223:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:10454:x1870604236031488:12345-0@lo:502:llog_process_th.0 Request processed in 146us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.754231:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783947380.755673:0:10454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.756707:0:10454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10454:1870604236031488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947380.756815:0:10454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947380.756826:0:10454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947380.756828:0:10454:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783947380.756834:0:10454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783947380.756958:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783947380.756990:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947380.757002:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.757015:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947380.757027:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947380.757030:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be784d800 from 4 10000000:01000000:1.0:1783947380.757032:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947380.759699:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.759713:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.759725:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947380.759768:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.759861:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.759918:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.759950:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236031616 00000100:00100000:1.0:1783947380.759959:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236031616 00000100:00100000:1.0:1783947380.760017:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783947380.760027:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236031616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947380.760055:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947380.760072:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550020a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.760100:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.760112:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.760122:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439e00, rc 0) 00000100:00100000:1.0:1783947380.760165:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236031616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.760173:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783947380.760237:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947380.760253:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.760263:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947380.760334:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.760362:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.760377:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.760391:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236031744 00000100:00100000:1.0:1783947380.760395:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236031744 00000100:00100000:1.0:1783947380.760417:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783947380.760423:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236031744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.762352:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236031744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1921us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.762365:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783947380.762440:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.763632:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.763907:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.763952:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.763973:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236031872 00000100:00100000:1.0:1783947380.763981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236031872 00000100:00100000:1.0:1783947380.764030:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783947380.764052:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236031872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.764166:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236031872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.764180:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783947380.764230:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236031872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.773707:0:10457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10457:1870604236032000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.780181:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.780247:0:10457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947380.780310:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032000 00000100:00100000:3.0:1783947380.780323:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032000 00000100:00100000:3.0:1783947380.780965:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783947380.780978:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10457:x1870604236032000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947380.781176:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10457:x1870604236032000:12345-0@lo:502:llog_process_th.0 Request processed in 200us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947380.781185:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783947380.785644:0:10457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10457:1870604236032000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947380.785698:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947380.785709:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947380.785711:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783947380.785720:0:10457:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7be784d800 00000020:00000080:1.0:1783947380.785722:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783947380.786135:0:10457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10457:1870604236032128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.786228:0:10457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.786268:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032128 00000100:00100000:1.0:1783947380.786276:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032128 00000100:00100000:1.0:1783947380.786332:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783947380.786341:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10457:x1870604236032128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.786493:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:10457:x1870604236032128:12345-0@lo:502:llog_process_th.0 Request processed in 152us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.786502:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783947380.786981:0:10457:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.787005:0:10457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10457:1870604236032128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783947380.787047:0:10457:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947380.787054:0:10457:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947380.787056:0:10457:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783947380.787068:0:10457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783947380.789979:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783947380.790028:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947380.790053:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.790067:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947380.790078:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947380.790081:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc9511800 from 4 10000000:01000000:3.0:1783947380.790083:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947380.790124:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.790132:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.790144:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947380.790175:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236032256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947380.790260:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947380.790304:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947380.790330:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032256 00000100:00100000:3.0:1783947380.790337:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032256 00000100:00100000:3.0:1783947380.790393:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783947380.790402:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236032256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947380.790417:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947380.790434:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500218 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.790497:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.790508:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.790518:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:3.0:1783947380.790714:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236032256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947380.790722:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783947380.790779:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236032256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947380.790794:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947380.790804:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947380.790866:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236032384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947380.790892:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947380.790915:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f83cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.791050:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032384 00000100:00100000:1.0:1783947380.791055:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032384 00000100:00100000:1.0:1783947380.791087:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783947380.791094:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236032384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.791227:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236032384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.791235:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783947380.791270:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236032384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.791302:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236032512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.791347:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947380.791359:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7dc03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.791369:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032512 00000100:00100000:1.0:1783947380.791372:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032512 00000100:00100000:1.0:1783947380.791392:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783947380.791398:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236032512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947380.791609:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236032512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.791616:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783947380.791672:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236032512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947380.792219:0:10460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10460:1870604236032640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947380.792267:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947380.792303:0:10460:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.792344:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032640 00000100:00100000:1.0:1783947380.792349:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032640 00000100:00100000:1.0:1783947380.792388:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783947380.792396:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:10460:x1870604236032640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.792501:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:10460:x1870604236032640:12345-0@lo:502:llog_process_th.0 Request processed in 105us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.792513:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783947380.792636:0:10460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10460:1870604236032640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947380.792664:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947380.792680:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947380.792682:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783947380.792689:0:10460:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bc9511800 00000020:00000080:3.0:1783947380.792692:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947380.792771:0:10460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10460:1870604236032768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947380.792804:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947380.792823:0:10460:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947380.792872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032768 00000100:00100000:1.0:1783947380.792876:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032768 00000100:00100000:1.0:1783947380.792902:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783947380.792909:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:10460:x1870604236032768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947380.792963:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:10460:x1870604236032768:12345-0@lo:502:llog_process_th.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.792969:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783947380.793401:0:10460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:10460:1870604236032768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947380.793421:0:10460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947380.793426:0:10460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947380.793428:0:10460:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783947380.793432:0:10460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783947380.793943:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783947380.793969:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947380.793980:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947380.793992:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947380.849788:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947380.849980:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950848 00000100:00100000:2.0:1783947380.849994:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950848 00000100:00100000:2.0:1783947380.850080:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 267 00000100:00100000:2.0:1783947380.850093:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:6179:x1870604213950848:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947380.850118:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947380.850154:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3da5 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947380.850203:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947380.850224:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947380.850253:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e600, rc 0) 00000100:00100000:2.0:1783947380.850326:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213950848:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 236us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947380.850345:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 267 00000100:00100000:2.0:1783947380.853846:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947380.853895:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213950976 00000100:00100000:2.0:1783947380.853907:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213950976 00000100:00100000:2.0:1783947380.853973:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 268 00000100:00100000:2.0:1783947380.853984:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213950976:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947380.854217:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213950976:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 234us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947380.854225:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 268 00000100:00100000:2.0:1783947380.866060:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947380.868545:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213951104 00000100:00100000:0.0:1783947380.868627:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213951104 00000100:00100000:0.0:1783947380.868705:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 269 00000100:00100000:0.0:1783947380.868718:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213951104:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947380.868935:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6179:x1870604213951104:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 219us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947380.868951:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 269 00000100:00100000:2.0:1783947380.887385:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947380.887440:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213951232 00000100:00100000:2.0:1783947380.887452:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213951232 00000100:00100000:2.0:1783947380.891393:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 270 00000100:00100000:2.0:1783947380.891420:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6723:x1870604213951232:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947380.891652:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6723:x1870604213951232:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 243us (4280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947380.891662:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 270 00000100:00100000:3.0:1783947380.904547:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947380.906817:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213951360 00000100:00100000:1.0:1783947380.906837:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213951360 00000100:00100000:1.0:1783947380.906929:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 271 00000100:00100000:1.0:1783947380.906943:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6723:x1870604213951360:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947380.907170:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:6723:x1870604213951360:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 218us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947380.907179:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 271 00010000:00010000:0.0:1783947380.917107:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947381.941140:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947382.004401:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236032896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947382.004686:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236033024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947382.007104:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947382.007613:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236032896 00000100:00100000:2.0:1783947382.007624:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236032896 00000100:00100000:0.0:1783947382.007762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947382.007801:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033024 00000100:00100000:3.0:1783947382.007805:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033024 00000100:00080000:1.0:1783947382.007842:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947382.007870:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947382.007882:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236032896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783947382.007934:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947382.008003:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236032896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947382.008028:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783947382.008425:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783947382.008434:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236033024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947382.008448:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947382.008519:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236033024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947382.008526:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1783947382.008818:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9500 x1870604236032896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947382.008846:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236032896:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783947382.008848:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640a680 x1870604236033024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947382.008862:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236033024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947382.517654:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947382.517694:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236033152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947382.517786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947382.518054:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033152 00000100:00100000:3.0:1783947382.518065:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033152 00000100:00100000:3.0:1783947382.518126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783947382.518196:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236033152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947382.518246:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947382.518381:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236033152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 178us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947382.518390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947382.518848:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236033152:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947382.964633:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947383.540366:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236033664:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.540568:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.540648:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236034176:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.540678:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.540726:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236034688:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.540768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.540804:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783947383.540810:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236033280:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.540840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.540862:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236033792:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.540887:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.540905:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236034304:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.540925:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.540939:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236034816:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541004:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.541039:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236033536:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.541093:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236034048:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.541129:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236034560:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.541183:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783947383.541189:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236033408:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541209:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.541234:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236033920:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.541263:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236034432:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947383.541334:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033664 00000100:00100000:2.0:1783947383.541342:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033664 00000100:00100000:2.0:1783947383.541401:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034048 00000100:00100000:2.0:1783947383.541420:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034048 00000100:00100000:2.0:1783947383.541486:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034560 00000100:00100000:2.0:1783947383.541490:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034560 00000100:00100000:2.0:1783947383.541504:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033408 00000100:00100000:2.0:1783947383.541507:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033408 00000100:00100000:2.0:1783947383.541548:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033920 00000100:00100000:2.0:1783947383.541566:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033920 00000100:00100000:2.0:1783947383.541581:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034432 00000100:00100000:2.0:1783947383.541584:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034432 00000100:00100000:2.0:1783947383.541620:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947383.541627:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236033664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541688:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236033664:12345-0@lo:400:kworker.0 Request processed in 61us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.541705:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947383.541723:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783947383.541729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236034048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236034048:12345-0@lo:400:kworker.0 Request processed in 35us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.541768:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783947383.541780:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947383.541786:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236034560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541814:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236034560:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.541819:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947383.541831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947383.541836:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236033408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541893:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236033408:12345-0@lo:400:kworker.0 Request processed in 56us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.541899:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947383.541910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947383.541917:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236033920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.541944:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236033920:12345-0@lo:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.541949:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947383.541960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783947383.541966:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236034432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542004:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236034432:12345-0@lo:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542017:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783947383.542041:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034176 00000100:00100000:2.0:1783947383.542045:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034176 00000100:00100000:2.0:1783947383.542072:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034688 00000100:00100000:2.0:1783947383.542075:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034688 00000100:00100000:2.0:1783947383.542090:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034304 00000100:00100000:2.0:1783947383.542093:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034304 00000100:00100000:2.0:1783947383.542103:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034816 00000100:00100000:2.0:1783947383.542106:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034816 00000100:00100000:2.0:1783947383.542118:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947383.542124:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236034176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542156:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236034176:12345-0@lo:400:kworker.0 Request processed in 32us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542161:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947383.542172:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947383.542177:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236034688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542203:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236034688:12345-0@lo:400:kworker.0 Request processed in 26us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542208:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947383.542217:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947383.542222:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236034304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542247:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236034304:12345-0@lo:400:kworker.0 Request processed in 25us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542253:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947383.542263:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947383.542268:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236034816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542307:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236034816:12345-0@lo:400:kworker.0 Request processed in 39us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542313:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947383.542333:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033280 00000100:00100000:2.0:1783947383.542337:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033280 00000100:00100000:2.0:1783947383.542366:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783947383.542372:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236033280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542401:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236033280:12345-0@lo:400:kworker.0 Request processed in 30us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542406:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783947383.542443:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033792 00000100:00100000:2.0:1783947383.542534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033792 00000100:00100000:2.0:1783947383.542598:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236033536 00000100:00100000:2.0:1783947383.542613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236033536 00000100:00100000:2.0:1783947383.542628:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947383.542666:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542728:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236033792:12345-0@lo:400:kworker.0 Request processed in 80us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542735:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783947383.542758:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783947383.542765:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236033536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.542829:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236033536:12345-0@lo:400:kworker.0 Request processed in 65us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.542853:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783947383.542966:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236033408:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.543061:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236033920:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.543085:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236034432:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.543097:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236033536:0@lo:400:kworker.0 00010000:00080000:2.0:1783947383.543134:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9c00 x1870604236034048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947383.543146:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236034048:0@lo:400:kworker.0 00010000:00080000:2.0:1783947383.543160:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ea300 x1870604236034560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947383.543168:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236034560:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.543226:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236033280:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.543238:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236033792:0@lo:400:kworker.0 00010000:00080000:2.0:1783947383.543280:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9f80 x1870604236034304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947383.543289:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236034304:0@lo:400:kworker.0 00010000:00080000:2.0:1783947383.543315:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9500 x1870604236034816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947383.543323:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236034816:0@lo:400:kworker.0 00000100:00100000:2.0:1783947383.543352:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236033664:0@lo:400:kworker.0 00010000:00080000:2.0:1783947383.543395:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9180 x1870604236034176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947383.543404:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236034176:0@lo:400:kworker.0 00010000:00080000:2.0:1783947383.543439:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e8a80 x1870604236034688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947383.543448:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236034688:0@lo:400:kworker.0 00000100:00080000:2.0:1783947383.543604:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947383.543610:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947383.543612:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947383.551799:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236034944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947383.551886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947383.551948:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236034944 00000100:00100000:1.0:1783947383.551955:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236034944 00000100:00100000:1.0:1783947383.552043:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783947383.552052:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236034944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947383.552087:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947383.553814:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236034944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1752us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947383.553829:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783947383.553930:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6408000 x1870604236034944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947383.553957:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236034944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947383.788997:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947383.789037:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947383.789061:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947383.789077:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947383.789095:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947383.789126:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213951744 00000100:00100000:2.0:1783947383.789137:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213951744 00000100:00100000:2.0:1783947383.789201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213951616 00000100:00100000:2.0:1783947383.789204:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213951616 00000100:00100000:2.0:1783947383.789225:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:2.0:1783947383.789234:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213951744:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947383.789314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213951744:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.789322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:2.0:1783947383.789337:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:2.0:1783947383.789343:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213951616:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947383.789381:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213951616:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 39us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.789387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:2.0:1783947383.789403:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952000 00000100:00100000:2.0:1783947383.789406:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952000 00000100:00100000:2.0:1783947383.789428:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213951872 00000100:00100000:2.0:1783947383.789431:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213951872 00000100:00100000:2.0:1783947383.789446:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1783947383.789451:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213952000:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947383.789490:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213952000:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 39us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.789496:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1783947383.789505:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1783947383.789511:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213951872:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947383.789527:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213951872:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 17us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947383.789532:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00080000:2.0:1783947383.789552:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783947383.789556:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947383.789559:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947383.789561:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947383.791094:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213951488 00000100:00100000:3.0:1783947383.791108:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213951488 00000100:00100000:3.0:1783947383.791168:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 273 00000100:00100000:3.0:1783947383.791179:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604213951488:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947383.791243:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604213951488:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 67us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947383.791251:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 273 00010000:00010000:2.0:1783947383.987704:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947384.054095:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236035072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947384.054197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947384.054400:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035072 00000100:00100000:1.0:1783947384.054410:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035072 00000100:00100000:1.0:1783947384.054505:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783947384.054521:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236035072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947384.054551:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947384.054623:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236035072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947384.054631:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1783947384.054698:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6408e00 x1870604236035072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947384.054719:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236035072:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783947385.011685:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947385.594767:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236035200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947385.594863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947385.594976:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035200 00000100:00100000:2.0:1783947385.594985:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035200 00000100:00100000:2.0:1783947385.595171:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783947385.595180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236035200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947385.595228:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947385.595285:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236035200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947385.595292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783947385.595423:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236035200:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947386.036576:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947386.276224:0:10689:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1783947387.060934:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947387.126842:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236035328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947387.126928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947387.126997:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035328 00000100:00100000:3.0:1783947387.127012:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035328 00000100:00100000:3.0:1783947387.127121:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947387.127135:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236035328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947387.127178:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947387.127304:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236035328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947387.127313:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1783947387.127384:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd2a00 x1870604236035328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947387.127419:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236035328:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783947387.128002:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947387.128642:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236035456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947387.128700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947387.128889:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035456 00000100:00100000:3.0:1783947387.128897:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035456 00000100:00100000:3.0:1783947387.128969:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783947387.128977:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236035456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947387.129002:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783947387.129092:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947387.129257:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236035456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 279us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947387.129265:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1783947387.129603:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6408e00 x1870604236035456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947387.129625:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236035456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947387.636362:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947387.636403:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236035584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947387.637033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947387.641324:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035584 00000100:00100000:0.0:1783947387.641357:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035584 00000100:00100000:0.0:1783947387.641485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947387.641499:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236035584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947387.641561:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947387.641681:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236035584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (4650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947387.641689:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783947387.641982:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236035584:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783947388.083655:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947388.660628:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947388.660661:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236035712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947388.660844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947388.660944:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035712 00000100:00100000:2.0:1783947388.660953:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035712 00000100:00100000:2.0:1783947388.661031:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783947388.661042:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236035712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947388.661078:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947388.661124:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236035712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.661132:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1783947388.661155:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783947388.661191:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd2680 x1870604236035712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947388.661211:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236035712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947388.661963:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947388.661982:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236035840:0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662046:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947388.662060:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236035968:0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662087:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236036224:0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.662110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947388.662143:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947388.662146:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236036480:0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662170:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236036736:0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.662180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947388.662203:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236036992:0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947388.662237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947388.662256:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236037248:0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.662265:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783947388.662275:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236036096:0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947388.662317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947388.662329:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783947388.662339:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236036352:0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.662344:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236036608:0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947388.662389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947388.662409:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236036864:0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.662412:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236037120:0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662449:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947388.662478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947388.662518:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036096 00000100:00100000:0.0:1783947388.662527:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036096 00000100:00100000:0.0:1783947388.662577:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036352 00000100:00100000:0.0:1783947388.662580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036352 00000100:00100000:0.0:1783947388.662599:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783947388.662607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236036096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662663:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236036096:12345-0@lo:400:kworker.0 Request processed in 56us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947388.662671:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783947388.662689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783947388.662696:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236036352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947388.662735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236036352:12345-0@lo:400:kworker.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947388.662741:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783947388.662774:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236036352:0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.664119:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035840 00000100:00100000:2.0:1783947388.664135:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035840 00000100:00100000:2.0:1783947388.664195:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783947388.664209:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236035840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.664307:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236035840:12345-0@lo:400:kworker.0 Request processed in 101us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.664315:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783947388.664361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236035968 00000100:00100000:2.0:1783947388.664366:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236035968 00000100:00100000:2.0:1783947388.664390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036224 00000100:00100000:2.0:1783947388.664394:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036224 00000100:00100000:2.0:1783947388.664408:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036480 00000100:00100000:2.0:1783947388.664410:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036480 00000100:00100000:2.0:1783947388.664435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036992 00000100:00100000:2.0:1783947388.664439:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036992 00000100:00100000:2.0:1783947388.664475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036608 00000100:00100000:2.0:1783947388.664478:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036608 00000100:00100000:2.0:1783947388.664497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236037120 00000100:00100000:2.0:1783947388.664523:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236037120 00000100:00100000:2.0:1783947388.664545:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947388.664552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236035968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.664593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236035968:12345-0@lo:400:kworker.0 Request processed in 42us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.664599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947388.664610:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783947388.664616:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236036224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.664666:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236036224:12345-0@lo:400:kworker.0 Request processed in 49us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.664673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783947388.664686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783947388.664693:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236036480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.664728:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236036480:12345-0@lo:400:kworker.0 Request processed in 35us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.664734:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783947388.664881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783947388.664904:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236036992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.664940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236036992:12345-0@lo:400:kworker.0 Request processed in 39us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.664959:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783947388.664975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783947388.664983:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236036608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.665017:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236036096:0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665018:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236036608:12345-0@lo:400:kworker.0 Request processed in 35us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.665046:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1783947388.665047:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ee680 x1870604236036608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947388.665062:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236036608:0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783947388.665076:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236037120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.665085:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236035968:0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.665099:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236036480:0@lo:400:kworker.0 00000100:00100000:3.0:1783947388.665118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236036992:0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236037120:12345-0@lo:400:kworker.0 Request processed in 43us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.665129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783947388.665169:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036736 00010000:00080000:3.0:1783947388.665174:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ec380 x1870604236037120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947388.665175:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036736 00000100:00100000:3.0:1783947388.665188:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236037120:0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665206:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236037248 00000100:00100000:2.0:1783947388.665211:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236037248 00000100:00100000:2.0:1783947388.665236:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236036864 00000100:00100000:2.0:1783947388.665239:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236036864 00000100:00100000:2.0:1783947388.665253:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947388.665260:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236036736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665296:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236036736:12345-0@lo:400:kworker.0 Request processed in 38us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.665303:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947388.665315:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947388.665321:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236037248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665351:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236037248:12345-0@lo:400:kworker.0 Request processed in 30us (3046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.665357:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947388.665368:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947388.665374:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236036864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665401:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236036864:12345-0@lo:400:kworker.0 Request processed in 27us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.665417:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1783947388.665540:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77eed80 x1870604236036864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947388.665553:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236036864:0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665565:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236036224:0@lo:400:kworker.0 00010000:00080000:2.0:1783947388.665576:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77edf80 x1870604236036736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947388.665585:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236036736:0@lo:400:kworker.0 00010000:00080000:2.0:1783947388.665596:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ef800 x1870604236037248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947388.665603:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236037248:0@lo:400:kworker.0 00000100:00100000:2.0:1783947388.665614:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236035840:0@lo:400:kworker.0 00000100:00080000:2.0:1783947388.665651:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947388.665657:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947388.665660:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947388.903070:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947388.903195:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947388.903243:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947388.903269:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947388.903320:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947388.903390:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952384 00000100:00100000:3.0:1783947388.903403:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952384 00000100:00100000:3.0:1783947388.903511:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952256 00000100:00100000:3.0:1783947388.903515:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952256 00000100:00100000:3.0:1783947388.903549:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:3.0:1783947388.903561:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213952384:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947388.903565:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:1.0:1783947388.903583:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213952256:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947388.904669:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213952384:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1100us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947388.904684:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:3.0:1783947388.904736:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952640 00000100:00100000:3.0:1783947388.904743:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952640 00000100:00100000:3.0:1783947388.904786:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952512 00000100:00100000:3.0:1783947388.904789:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952512 00000100:00100000:3.0:1783947388.904814:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1783947388.904823:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213952640:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947388.906612:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952128 00000100:00100000:2.0:1783947388.906628:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952128 00000100:00100000:2.0:1783947388.906703:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 275 00000100:00100000:2.0:1783947388.906712:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213952128:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947388.913558:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213952256:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 9960us (10266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947388.913580:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:3.0:1783947388.916095:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213952640:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 11253us (12832us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947388.916114:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1783947388.916171:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:3.0:1783947388.916185:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bef960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213952512:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947388.916249:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bef960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213952512:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 70us (12929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947388.916256:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00080000:3.0:1783947388.916523:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947388.916529:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947388.916534:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947388.916537:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947388.918559:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213952128:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 11829us (15488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947388.918577:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 275 00010000:00010000:1.0:1783947389.108030:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947389.171971:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236037376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947389.172100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947389.172191:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236037376 00000100:00100000:1.0:1783947389.172200:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236037376 00000100:00100000:1.0:1783947389.172263:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947389.172272:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236037376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947389.172304:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947389.172348:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236037376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947389.172366:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1783947389.172407:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6409f80 x1870604236037376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947389.172424:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236037376:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947390.132825:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947390.707745:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236037504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947390.707841:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947390.707944:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236037504 00000100:00100000:2.0:1783947390.707953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236037504 00000100:00100000:2.0:1783947390.708003:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947390.708012:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236037504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947390.708052:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947390.708099:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236037504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947390.708107:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947390.708161:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236037504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947391.161708:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947391.948242:0:10933:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing yml_node 00010000:00010000:2.0:1783947392.182241:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947392.245400:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236037632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947392.245494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947392.245573:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236037632 00000100:00100000:1.0:1783947392.245581:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236037632 00000100:00100000:1.0:1783947392.245641:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947392.245651:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236037632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947392.245690:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947392.245739:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236037632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947392.245746:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1783947392.245769:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783947392.245804:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6409f80 x1870604236037632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947392.245837:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236037632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947392.247604:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947392.247625:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236037760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947392.247682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947392.247734:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236037760 00000100:00100000:1.0:1783947392.247744:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236037760 00000100:00100000:1.0:1783947392.247798:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947392.247806:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236037760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947392.247838:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947392.247880:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236037760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947392.247887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1783947392.248840:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783947392.249024:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6409f80 x1870604236037760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947392.249052:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236037760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947392.755753:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236037888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947392.755845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947392.756181:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236037888 00000100:00100000:3.0:1783947392.756191:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236037888 00000100:00100000:3.0:1783947392.756250:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947392.756260:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236037888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947392.756295:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947392.756365:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236037888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947392.756372:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783947392.756498:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236037888:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947393.205523:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947393.779684:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236038016:0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.779765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947393.779838:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947393.779856:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236038144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947393.779886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947393.779922:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038144 00000100:00100000:1.0:1783947393.779930:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038144 00000100:00080000:0.0:1783947393.780320:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947393.780354:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038016 00000100:00100000:0.0:1783947393.780358:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038016 00000100:00100000:0.0:1783947393.780405:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783947393.780414:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236038016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.780497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236038016:12345-0@lo:400:kworker.0 Request processed in 84us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947393.780505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783947393.780568:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236038016:0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.780779:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947393.780797:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236038144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947393.780823:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947393.780875:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236038144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947393.780881:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947393.781225:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236038528:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.781260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783947393.781292:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd2680 x1870604236038144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947393.781308:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236038144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947393.781355:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038528 00000100:00100000:0.0:1783947393.781359:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038528 00000100:00100000:0.0:1783947393.781389:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783947393.781396:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.781430:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236038528:12345-0@lo:400:kworker.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947393.781436:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783947393.781487:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236038528:0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.781707:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236038272:0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.781738:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947393.781757:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947393.781762:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236038400:0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.781783:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947393.781825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038272 00000100:00100000:1.0:1783947393.781839:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038272 00000100:00100000:1.0:1783947393.781881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947393.781887:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236038272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.781924:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236038272:12345-0@lo:400:kworker.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947393.781931:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947393.781949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038400 00000100:00100000:1.0:1783947393.781953:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038400 00000100:00100000:1.0:1783947393.781998:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783947393.782005:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.782039:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236038400:12345-0@lo:400:kworker.0 Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947393.782045:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783947393.782069:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236038400:0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.782079:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236038272:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.794144:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236038656:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.794220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947393.794423:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236038912:0@lo:400:kworker.0 00000100:00100000:3.0:1783947393.794479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947393.796066:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236039040:0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.796515:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038656 00000100:00100000:1.0:1783947393.796524:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038656 00000100:00100000:1.0:1783947393.796576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783947393.796584:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236038656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.797691:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236039168:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.797747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947393.797816:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039168 00000100:00100000:0.0:1783947393.797836:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039168 00000100:00100000:0.0:1783947393.797879:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947393.797887:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236039168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.797945:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236039168:12345-0@lo:400:kworker.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947393.797953:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947393.798057:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038912 00000100:00100000:0.0:1783947393.798062:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038912 00000100:00100000:0.0:1783947393.798686:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783947393.798697:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236038912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.798743:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236038912:12345-0@lo:400:kworker.0 Request processed in 50us (4264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947393.798750:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1783947393.798772:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783947393.798821:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7beeee8e00 x1870604236039168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947393.798836:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236039168:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.798900:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236038784:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.798933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947393.798957:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236039296:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.798977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947393.799476:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236038784 00000100:00100000:0.0:1783947393.799481:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236038784 00000100:00100000:0.0:1783947393.799650:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039296 00000100:00100000:0.0:1783947393.799654:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039296 00000100:00100000:0.0:1783947393.799677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783947393.799684:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236038784:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783947393.799709:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cba300 x1870604236038912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947393.799725:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236038912:0@lo:400:kworker.0 00000100:00100000:3.0:1783947393.799734:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236039424:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.799753:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236038784:12345-0@lo:400:kworker.0 Request processed in 69us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947393.799762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783947393.799776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947393.799781:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783947393.799802:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236039296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.799838:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236039296:12345-0@lo:400:kworker.0 Request processed in 50us (859us total) trans 0 rc 0/0 00000100:00080000:3.0:1783947393.799840:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947393.799848:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783947393.799854:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039424 00000100:00100000:3.0:1783947393.799866:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039424 00000100:00100000:0.0:1783947393.799884:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236038784:0@lo:400:kworker.0 00000100:00100000:0.0:1783947393.799899:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236039296:0@lo:400:kworker.0 00000100:00100000:3.0:1783947393.799906:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947393.799916:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236039424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947393.799958:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236039424:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0 00010000:00080000:0.0:1783947393.799973:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6610000 x1870604236039424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947393.800063:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236039424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947393.800694:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1783947393.800720:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947393.802844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947393.802905:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236039552:0@lo:400:kworker.0 00000100:00100000:2.0:1783947393.802947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947393.803116:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039040 00000100:00100000:0.0:1783947393.803126:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039040 00000100:00100000:1.0:1783947393.803168:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236038656:12345-0@lo:400:kworker.0 Request processed in 6580us (8943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947393.803180:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039552 00000100:00100000:1.0:1783947393.803181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947393.803186:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039552 00000100:00100000:0.0:1783947393.803224:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947393.803235:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236039040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947393.803238:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947393.803251:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236039552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947393.803359:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236038656:0@lo:400:kworker.0 00000100:00080000:2.0:1783947393.803394:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947393.803433:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236039040:12345-0@lo:400:kworker.0 Request processed in 200us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947393.803439:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947393.804682:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236039552:12345-0@lo:400:kworker.0 Request processed in 1428us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947393.804714:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1783947393.807534:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8000 x1870604236039040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947393.807553:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236039040:0@lo:400:kworker.0 00010000:00080000:0.0:1783947393.810919:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6613b80 x1870604236039552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947393.810939:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236039552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947394.028647:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947394.028692:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947394.028705:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952768 00000100:00100000:2.0:1783947394.028718:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952768 00000100:00100000:3.0:1783947394.028730:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947394.028791:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 277 00000100:00100000:2.0:1783947394.028805:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2409:x1870604213952768:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947394.028919:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2409:x1870604213952768:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947394.028923:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953024 00000100:00100000:0.0:1783947394.028929:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953024 00000100:00100000:2.0:1783947394.028933:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 277 00000100:00080000:2.0:1783947394.028973:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947394.028982:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213952896 00000100:00100000:0.0:1783947394.028986:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213952896 00000100:00100000:2.0:1783947394.029015:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:2.0:1783947394.029159:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213953024:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947394.029197:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213953024:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 174us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947394.031727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:0.0:1783947394.031768:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213952896:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947394.031883:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213952896:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 139us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947394.031892:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00080000:0.0:1783947394.031952:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947394.035696:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:0.0:1783947394.037663:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947394.037867:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947394.040086:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953152 00000100:00100000:3.0:1783947394.040102:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953152 00000100:00100000:3.0:1783947394.040226:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953280 00000100:00100000:3.0:1783947394.040230:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953280 00000100:00080000:0.0:1783947394.040257:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947394.040263:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947394.044728:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1783947394.044759:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2405:x1870604213953152:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:2.0:1783947394.044815:0:8539:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550013f 00000100:00080000:2.0:1783947394.044828:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73c9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783947394.044928:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1783947394.045221:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+2:2405:x1870604213953152:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 382us (7471us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947394.045231:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1783947394.045253:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:2.0:1783947394.045262:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2405:x1870604213953280:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:2.0:1783947394.045278:0:8539:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500138 00000100:00080000:2.0:1783947394.045284:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9e7ac65c3800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783947394.045310:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1783947394.049482:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1783947394.049704:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+2:2405:x1870604213953280:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 4436us (11830us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947394.049736:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00010000:00010000:0.0:1783947394.052604:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947394.227795:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947394.291718:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236039680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947394.291875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947394.292019:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039680 00000100:00100000:3.0:1783947394.292028:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039680 00000100:00100000:3.0:1783947394.292094:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783947394.292104:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236039680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947394.292128:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947394.292178:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236039680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947394.292186:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1783947394.292389:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc55bb480 x1870604236039680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947394.293057:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc55bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236039680:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947395.254665:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947395.830583:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947395.830713:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236039808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947395.830866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947395.831005:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039808 00000100:00100000:2.0:1783947395.831082:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039808 00000100:00100000:2.0:1783947395.831167:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783947395.831187:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236039808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947395.831234:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947395.833158:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236039808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1973us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947395.833170:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783947395.833329:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236039808:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1783947395.891030:0:11116:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:0.0:1783947396.275736:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947397.300071:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947397.364738:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947397.364763:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236039936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947397.364851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947397.364966:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236039936 00000100:00100000:1.0:1783947397.364983:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236039936 00000100:00100000:1.0:1783947397.365046:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947397.365056:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236039936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947397.365087:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947397.365132:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236039936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947397.365139:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1783947397.365178:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ceb480 x1870604236039936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947397.365194:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236039936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783947397.366179:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947397.366670:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947397.368036:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236040064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947397.368111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947397.368348:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040064 00000100:00100000:1.0:1783947397.368357:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040064 00000100:00100000:1.0:1783947397.368431:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947397.368440:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236040064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947397.368481:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947397.368538:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236040064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947397.368545:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1783947397.368783:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd2680 x1870604236040064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947397.368804:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236040064:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783947397.376794:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947397.876815:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236040192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947397.876890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947397.876987:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040192 00000100:00100000:2.0:1783947397.876996:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040192 00000100:00100000:2.0:1783947397.877048:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947397.877058:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236040192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947397.877106:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947397.878185:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236040192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1124us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947397.878197:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236040192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947397.878267:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000001:02000400:0.0:1783947398.143188:0:11214:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:3.0:1783947398.332625:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947398.902116:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236040320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947398.902184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947398.902251:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040320 00000100:00100000:3.0:1783947398.902258:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040320 00000100:00100000:3.0:1783947398.902310:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947398.902319:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236040320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947398.902353:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947398.902397:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236040320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947398.902404:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1783947398.902425:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783947398.902471:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cba300 x1870604236040320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947398.902490:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236040320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947398.905117:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236040576:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.905279:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236041088:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.905330:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac646d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236041600:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.905375:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783947398.905381:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236040704:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.905421:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236041216:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.905479:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac646f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236041728:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.905530:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040576 00000100:00100000:1.0:1783947398.905537:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040576 00000100:00100000:1.0:1783947398.905572:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041088 00000100:00100000:1.0:1783947398.905574:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041088 00000100:00100000:1.0:1783947398.905595:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041600 00000100:00100000:1.0:1783947398.905597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041600 00000100:00100000:1.0:1783947398.905607:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041216 00000100:00100000:1.0:1783947398.905610:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041216 00000100:00100000:1.0:1783947398.905618:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041728 00000100:00100000:1.0:1783947398.905621:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041728 00000100:00100000:1.0:1783947398.905634:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783947398.905641:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236040576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905710:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236040576:12345-0@lo:400:kworker.0 Request processed in 68us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.905724:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783947398.905741:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947398.905747:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236041088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905776:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236041088:12345-0@lo:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.905782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947398.905794:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783947398.905799:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236041600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905825:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236041600:12345-0@lo:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.905831:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783947398.905842:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783947398.905847:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236041216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905872:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236041216:12345-0@lo:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.905877:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783947398.905888:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947398.905894:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236041728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.905919:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236041728:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.905925:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947398.905949:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040704 00000100:00100000:1.0:1783947398.905953:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040704 00000100:00100000:1.0:1783947398.905977:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783947398.905983:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236040704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.906018:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236040704:12345-0@lo:400:kworker.0 Request processed in 35us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.906023:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783947398.906043:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947398.906047:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947398.906056:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236040832:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.906078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.906092:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac646e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236041344:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.906110:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.906128:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac646fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236041856:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.906144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.906163:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783947398.906169:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236040448:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.906560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.907297:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236040960:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907328:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.907357:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac646e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236041472:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947398.907411:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041344 00000100:00100000:1.0:1783947398.907416:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041344 00000100:00100000:1.0:1783947398.907451:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041856 00000100:00100000:1.0:1783947398.907475:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041856 00000100:00100000:1.0:1783947398.907504:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041472 00000100:00100000:1.0:1783947398.907508:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041472 00000100:00100000:1.0:1783947398.907520:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947398.907527:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236041344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907587:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236041344:12345-0@lo:400:kworker.0 Request processed in 59us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.907594:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947398.907608:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783947398.907615:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236041856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907645:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236041856:12345-0@lo:400:kworker.0 Request processed in 31us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.907651:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783947398.907662:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947398.907668:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236041472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907707:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236041472:12345-0@lo:400:kworker.0 Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.907713:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1783947398.907743:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947398.907773:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236040704:0@lo:400:kworker.0 00010000:00080000:1.0:1783947398.907790:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7be78d9880 x1870604236041216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947398.907801:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236041216:0@lo:400:kworker.0 00010000:00080000:1.0:1783947398.907813:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac646f100 x1870604236041728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947398.907822:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac646f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236041728:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907835:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236040576:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907847:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236041088:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907870:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac646d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236041600:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907910:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040832 00000100:00100000:1.0:1783947398.907914:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040832 00000100:00100000:1.0:1783947398.907939:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783947398.907945:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236040832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.907977:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236040832:12345-0@lo:400:kworker.0 Request processed in 32us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.907983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1783947398.908010:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac646e300 x1870604236041472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947398.908013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040960 00000100:00100000:3.0:1783947398.908017:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040960 00000100:00100000:1.0:1783947398.908019:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac646e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236041472:0@lo:400:kworker.0 00000100:00100000:1.0:1783947398.908028:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236040832:0@lo:400:kworker.0 00010000:00080000:1.0:1783947398.908037:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac646e680 x1870604236041344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947398.908042:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947398.908045:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac646e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236041344:0@lo:400:kworker.0 00000100:00100000:3.0:1783947398.908048:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236040960:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1783947398.908054:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac646fb80 x1870604236041856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947398.908062:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac646fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236041856:0@lo:400:kworker.0 00000100:00100000:3.0:1783947398.908080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236040960:12345-0@lo:400:kworker.0 Request processed in 32us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947398.908080:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236040960:0@lo:400:kworker.0 00000100:00100000:3.0:1783947398.908086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783947398.915886:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236040448 00000100:00100000:2.0:1783947398.915907:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236040448 00000100:00100000:3.0:1783947398.916010:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783947398.916021:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236040448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947398.916119:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236040448:12345-0@lo:400:kworker.0 Request processed in 100us (9557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947398.916134:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783947398.916280:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236040448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947399.144681:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947399.144735:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947399.144764:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947399.144795:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953664 00000100:00100000:3.0:1783947399.144804:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953664 00000100:00100000:1.0:1783947399.144820:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953408 00000100:00100000:1.0:1783947399.144826:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953408 00000100:00100000:1.0:1783947399.144880:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 279 00000100:00100000:3.0:1783947399.144886:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953536 00000100:00100000:1.0:1783947399.144892:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213953408:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947399.144893:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953536 00000100:00100000:3.0:1783947399.144924:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:3.0:1783947399.144934:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213953664:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947399.144970:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213953408:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947399.144978:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213953664:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947399.144984:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 279 00000100:00100000:3.0:1783947399.144991:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:3.0:1783947399.145011:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:3.0:1783947399.145018:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213953536:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947399.145046:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213953536:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947399.145052:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00080000:3.0:1783947399.145075:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947399.145080:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783947399.347708:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947399.411859:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac646fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236041984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947399.411945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947399.412025:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236041984 00000100:00100000:3.0:1783947399.412032:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236041984 00000100:00100000:3.0:1783947399.412081:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783947399.412090:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236041984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947399.412141:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947399.412189:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236041984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947399.412197:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1783947399.412239:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac646fb80 x1870604236041984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947399.412258:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac646fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236041984:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1783947399.929791:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:0.0:1783947399.929804:0:8421:0:(genops.c:906:class_export_put()) final put ffff9e7ac73ce000/1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:2.0:1783947399.933419:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac73ce000/1eb923ac-790a-478f-897e-124614dbce09 for lustre-OST0000 00000020:00000080:2.0:1783947399.933552:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac73c9800 for lustre-OST0000 00000001:00100000:3.0:1783947399.934336:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:3.0:1783947399.934343:0:9507:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c1800/1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:1.0:1783947399.934892:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c1800/1eb923ac-790a-478f-897e-124614dbce09 for lustre-OST0001 00000020:00000080:1.0:1783947399.934953:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac65c3800 for lustre-OST0001 00010000:00010000:0.0:1783947400.372183:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947400.899211:0:11311:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00000100:00100000:1.0:1783947400.949097:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236042112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947400.949169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947400.949320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236042112 00000100:00100000:2.0:1783947400.949328:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236042112 00000100:00100000:2.0:1783947400.949382:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783947400.949391:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236042112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947400.949430:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947400.949514:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236042112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947400.949525:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783947400.949657:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236042112:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947401.397940:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947402.420278:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947402.483841:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947402.483866:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236042240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947402.483936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947402.485550:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947402.485570:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236042368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947402.485630:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236042240 00000100:00100000:2.0:1783947402.485639:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236042240 00000100:00100000:1.0:1783947402.485642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947402.485726:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236042368 00000100:00100000:3.0:1783947402.485730:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236042368 00000100:00100000:3.0:1783947402.485785:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783947402.485795:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236042368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947402.485828:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947402.485875:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236042368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947402.485882:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1783947402.485918:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7500a80 x1870604236042368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947402.485937:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236042368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783947402.486107:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947402.486179:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783947402.486187:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236042240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783947402.486199:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947402.486241:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236042240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947402.486256:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1783947402.486328:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd2680 x1870604236042240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947402.486343:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236042240:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783947402.486397:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1783947402.624938:0:11359:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 08:56:40 EDT 2026 00000100:00100000:1.0:1783947402.995882:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236042496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947402.995970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947402.996199:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236042496 00000100:00100000:3.0:1783947402.996208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236042496 00000100:00100000:3.0:1783947402.996261:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783947402.996270:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236042496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947402.996327:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947402.996383:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236042496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947402.996390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947402.996536:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236042496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783947403.447909:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947404.021694:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236042624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947404.021770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.021863:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236042624 00000100:00100000:2.0:1783947404.021871:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236042624 00000100:00100000:2.0:1783947404.021932:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783947404.021950:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236042624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947404.021983:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783947404.021998:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947404.023262:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236042624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1309us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947404.023273:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783947404.023607:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236042752:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.023656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783947404.023727:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7500a80 x1870604236042624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947404.023750:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236042624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947404.024013:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236042880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.024182:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236043008:0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.024213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.024249:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043008 00000100:00100000:2.0:1783947404.024255:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043008 00000100:00100000:2.0:1783947404.024290:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783947404.024297:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236043008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.024345:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236043008:12345-0@lo:400:kworker.0 Request processed in 48us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947404.024351:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783947404.024378:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236043008:0@lo:400:kworker.0 00000100:00100000:0.0:1783947404.024422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.024527:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236042880 00000100:00100000:2.0:1783947404.024531:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236042880 00000100:00100000:1.0:1783947404.024547:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947404.024560:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236043136:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.024601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947404.025011:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236043520:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.025087:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236043264:0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.025098:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043136 00000100:00100000:2.0:1783947404.025103:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043136 00000100:00100000:1.0:1783947404.025123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.025135:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783947404.025144:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236042880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.025147:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236043776:0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.025188:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236042880:12345-0@lo:400:kworker.0 Request processed in 45us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947404.025200:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783947404.025203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.025221:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783947404.025230:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236043136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.025230:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783947404.025239:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236043648:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.025273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.025282:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236043136:12345-0@lo:400:kworker.0 Request processed in 53us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947404.025290:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783947404.025295:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236044160:0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.025312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043264 00000100:00100000:2.0:1783947404.025316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043264 00000100:00100000:1.0:1783947404.025321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.025347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947404.025353:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236043136:0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.025356:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236043264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.025383:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236042752 00000100:00100000:1.0:1783947404.025388:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236042752 00000100:00100000:2.0:1783947404.025400:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236043264:12345-0@lo:400:kworker.0 Request processed in 45us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947404.025407:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947404.025419:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1783947404.025425:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236042752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.025474:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236043264:0@lo:400:kworker.0 00000100:00100000:0.0:1783947404.025720:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236043392:0@lo:400:kworker.0 00000100:00100000:0.0:1783947404.025759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947404.025774:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236042752:12345-0@lo:400:kworker.0 Request processed in 347us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947404.025784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783947404.025784:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236043904:0@lo:400:kworker.0 00000100:00100000:0.0:1783947404.025814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947404.025840:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236042880:0@lo:400:kworker.0 00000100:00100000:0.0:1783947404.025860:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043392 00000100:00100000:0.0:1783947404.025863:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043392 00000100:00100000:0.0:1783947404.025891:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043904 00000100:00100000:0.0:1783947404.025893:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043904 00000100:00100000:0.0:1783947404.025908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783947404.025913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236043392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.025924:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043776 00000100:00100000:1.0:1783947404.025929:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043776 00000100:00100000:1.0:1783947404.025963:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043648 00000100:00100000:0.0:1783947404.025966:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236043392:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947404.025967:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043648 00000100:00100000:0.0:1783947404.025976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783947404.025993:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783947404.025998:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236043904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947404.026025:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236043904:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947404.026030:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1783947404.026059:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947404.026064:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947404.026093:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236043392:0@lo:400:kworker.0 00000100:00100000:0.0:1783947404.026101:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236043904:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.026138:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044160 00000100:00100000:1.0:1783947404.026143:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044160 00000100:00100000:1.0:1783947404.026179:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947404.026187:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236043776:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783947404.026198:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947404.026223:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236043776:12345-0@lo:400:kworker.0 Request processed in 36us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947404.026231:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947404.026246:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1783947404.026251:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0700 x1870604236043776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947404.026256:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236043648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.026266:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236043776:0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.026278:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236042752:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.026306:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236043648:12345-0@lo:400:kworker.0 Request processed in 52us (1032us total) trans 0 rc 0/0 00010000:00080000:2.0:1783947404.026310:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e3480 x1870604236043648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947404.026319:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783947404.026324:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236043648:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.026338:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947404.026346:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236044160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947404.026381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947404.026389:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236044160:12345-0@lo:400:kworker.0 Request processed in 43us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947404.026395:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1783947404.026449:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7146d80 x1870604236044160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947404.026481:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236044160:0@lo:400:kworker.0 00000100:00100000:3.0:1783947404.026556:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236044032:0@lo:400:kworker.0 00000100:00100000:3.0:1783947404.026643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947404.026774:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236043520 00000100:00100000:2.0:1783947404.026778:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236043520 00000100:00100000:2.0:1783947404.026820:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044032 00000100:00100000:2.0:1783947404.026823:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044032 00000100:00100000:2.0:1783947404.026842:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947404.026848:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236043520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.026885:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236043520:12345-0@lo:400:kworker.0 Request processed in 37us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947404.026890:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947404.026902:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783947404.026907:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236044032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947404.026937:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236044032:12345-0@lo:400:kworker.0 Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947404.026943:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1783947404.026988:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783947404.027008:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e1880 x1870604236043520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947404.027017:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236043520:0@lo:400:kworker.0 00010000:00080000:3.0:1783947404.027026:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0a80 x1870604236044032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947404.027033:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236044032:0@lo:400:kworker.0 00000100:00100000:1.0:1783947404.265627:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947404.265752:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947404.265781:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947404.270938:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953792 00000100:00100000:3.0:1783947404.270951:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953792 00000100:00100000:3.0:1783947404.271005:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 281 00000100:00100000:3.0:1783947404.271015:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213953792:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947404.271095:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2408:x1870604213953792:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 81us (5341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947404.271103:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 281 00000100:00100000:3.0:1783947404.271142:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213953920 00000100:00100000:3.0:1783947404.271154:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213953920 00000100:00100000:3.0:1783947404.271187:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954048 00000100:00100000:3.0:1783947404.271190:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954048 00000100:00100000:3.0:1783947404.271211:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:3.0:1783947404.271216:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213953920:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947404.271247:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213953920:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (5627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947404.271253:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:3.0:1783947404.271264:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:3.0:1783947404.271270:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213954048:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947404.271294:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213954048:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (5512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947404.271301:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00080000:3.0:1783947404.272256:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947404.272262:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783947404.467784:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947404.533496:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236044288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947404.533573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947404.533758:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044288 00000100:00100000:1.0:1783947404.533766:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044288 00000100:00100000:1.0:1783947404.533823:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947404.533832:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236044288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947404.533857:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947404.533909:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236044288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947404.533916:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1783947404.533982:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7be78d9500 x1870604236044288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947404.534000:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236044288:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947405.492674:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947406.068163:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947406.068194:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236044416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947406.068287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947406.068670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044416 00000100:00100000:1.0:1783947406.068679:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044416 00000100:00100000:1.0:1783947406.072617:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783947406.072651:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236044416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947406.072697:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783947406.072796:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236044416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (4510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947406.072822:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783947406.073015:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236044416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947406.517174:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947407.540749:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947407.603844:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236044544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947407.603921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947407.603997:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044544 00000100:00100000:0.0:1783947407.604005:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044544 00000100:00100000:0.0:1783947407.604060:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783947407.604069:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236044544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947407.604101:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947407.604154:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236044544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947407.604162:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783947407.604181:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947407.604208:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d6b800 x1870604236044544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947407.604227:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236044544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947407.606194:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236044672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947407.606255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947407.606366:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044672 00000100:00100000:2.0:1783947407.606373:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044672 00000100:00100000:2.0:1783947407.606482:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947407.606490:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236044672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783947407.606513:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947407.606568:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236044672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947407.606575:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1783947407.606615:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d68e00 x1870604236044672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947407.606633:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236044672:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783947407.606866:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947408.124346:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236044800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947408.124416:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947408.124547:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044800 00000100:00100000:2.0:1783947408.124560:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044800 00000100:00100000:2.0:1783947408.124620:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783947408.124630:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236044800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947408.124670:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947408.128406:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236044800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3768us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947408.128422:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783947408.130177:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236044800:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947408.569416:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947409.141725:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236044928:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.141803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947409.142687:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236045056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947409.142730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947409.142772:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045056 00000100:00100000:0.0:1783947409.142779:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045056 00000100:00100000:0.0:1783947409.142846:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783947409.142856:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236045056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947409.142887:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947409.142931:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236045056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947409.142938:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783947409.142958:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783947409.142988:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d6aa00 x1870604236045056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947409.143005:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236045056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947409.143267:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236044928 00000100:00100000:1.0:1783947409.143274:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236044928 00000100:00100000:1.0:1783947409.143307:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783947409.143315:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236044928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.143363:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236044928:12345-0@lo:400:kworker.0 Request processed in 48us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.143369:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783947409.144236:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236044928:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.144661:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947409.144750:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236045184:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.144799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.144839:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045184 00000100:00100000:1.0:1783947409.144845:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045184 00000100:00100000:1.0:1783947409.144886:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783947409.144895:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236045184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.145042:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236045184:12345-0@lo:400:kworker.0 Request processed in 147us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.145059:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783947409.145094:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236045184:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.145133:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236045312:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.145161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.145192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045312 00000100:00100000:1.0:1783947409.145195:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045312 00000100:00100000:1.0:1783947409.145224:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783947409.145232:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236045312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.145276:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236045312:12345-0@lo:400:kworker.0 Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.145283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783947409.145315:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236045312:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.145356:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236045440:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.145393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947409.145605:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045440 00000100:00100000:3.0:1783947409.145611:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045440 00000100:00100000:3.0:1783947409.145652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783947409.145660:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236045440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947409.145706:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236045440:12345-0@lo:400:kworker.0 Request processed in 47us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947409.145714:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783947409.145863:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236045568:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.145891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.146118:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236045440:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.146163:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947409.146169:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236045696:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.146194:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.146218:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045696 00000100:00100000:1.0:1783947409.146222:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045696 00000100:00100000:1.0:1783947409.146257:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783947409.146263:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236045696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.146310:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236045696:12345-0@lo:400:kworker.0 Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.146317:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1783947409.146335:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947409.146356:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236045696:0@lo:400:kworker.0 00000100:00100000:2.0:1783947409.146438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045568 00000100:00100000:2.0:1783947409.146443:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045568 00000100:00100000:2.0:1783947409.146558:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783947409.146565:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236045568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947409.146611:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236045568:12345-0@lo:400:kworker.0 Request processed in 46us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947409.146755:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947409.147140:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236045568:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.147175:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236045952:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.147203:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.147232:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045952 00000100:00100000:1.0:1783947409.147235:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045952 00000100:00100000:1.0:1783947409.147264:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783947409.147271:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236045952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.147307:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236045952:12345-0@lo:400:kworker.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.147313:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783947409.147332:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783947409.147351:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0700 x1870604236045952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947409.147361:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236045952:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.147401:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236046080:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.147423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.147445:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046080 00000100:00100000:1.0:1783947409.147449:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046080 00000100:00100000:2.0:1783947409.147577:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236045824:0@lo:400:kworker.0 00000100:00100000:2.0:1783947409.147610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947409.147917:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236045824 00000100:00100000:2.0:1783947409.147922:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236045824 00000100:00100000:2.0:1783947409.147959:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783947409.147966:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236045824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947409.148005:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236045824:12345-0@lo:400:kworker.0 Request processed in 40us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947409.148014:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1783947409.148030:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783947409.148050:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e1880 x1870604236045824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947409.148062:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236045824:0@lo:400:kworker.0 00000100:00100000:0.0:1783947409.149570:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236046208:0@lo:400:kworker.0 00000100:00100000:0.0:1783947409.149624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947409.149674:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947409.149680:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236046336:0@lo:400:kworker.0 00000100:00100000:0.0:1783947409.149710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.150305:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947409.150317:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236046080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.150394:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236046080:12345-0@lo:400:kworker.0 Request processed in 67us (2957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.150402:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783947409.150430:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046208 00000100:00100000:1.0:1783947409.150437:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046208 00000100:00100000:1.0:1783947409.150478:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046336 00000100:00100000:2.0:1783947409.151827:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783947409.151847:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236046208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947409.151949:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236046208:12345-0@lo:400:kworker.0 Request processed in 111us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947409.151956:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783947409.151996:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236046464:0@lo:400:kworker.0 00000100:00100000:2.0:1783947409.152034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947409.152161:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236046208:0@lo:400:kworker.0 00000100:00080000:0.0:1783947409.152521:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947409.152527:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947409.152557:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0700 x1870604236046080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947409.152571:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236046080:0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.153420:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046336 00000100:00080000:0.0:1783947409.153506:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947409.153520:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947409.153531:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236046336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.153610:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236046336:12345-0@lo:400:kworker.0 Request processed in 81us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.153617:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947409.153641:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046464 00000100:00100000:1.0:1783947409.153645:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046464 00000100:00100000:1.0:1783947409.153679:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783947409.153687:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236046464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947409.153729:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236046464:12345-0@lo:400:kworker.0 Request processed in 43us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.153736:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1783947409.153756:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947409.153784:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5840700 x1870604236046464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947409.153796:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236046464:0@lo:400:kworker.0 00010000:00080000:0.0:1783947409.153950:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cdca80 x1870604236046336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947409.153962:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236046336:0@lo:400:kworker.0 00000100:00100000:2.0:1783947409.394057:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947409.394151:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947409.394254:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947409.394284:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954432 00000100:00100000:2.0:1783947409.394292:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954432 00000100:00100000:2.0:1783947409.394348:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954304 00000100:00100000:2.0:1783947409.394351:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954304 00000100:00100000:2.0:1783947409.394374:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 113 00000100:00100000:2.0:1783947409.394383:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213954432:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947409.394478:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213954432:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947409.394496:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 113 00000100:00100000:2.0:1783947409.394514:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:2.0:1783947409.394521:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213954304:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947409.394566:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213954304:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947409.394572:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00080000:2.0:1783947409.394590:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947409.394601:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947409.396264:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954176 00000100:00100000:3.0:1783947409.396274:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954176 00000100:00100000:3.0:1783947409.396415:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 283 00000100:00100000:3.0:1783947409.396424:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2406:x1870604213954176:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947409.398359:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2406:x1870604213954176:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1928us (4303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947409.398374:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 283 00010000:00010000:1.0:1783947409.587643:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947409.651898:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947409.651919:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236046592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947409.651994:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947409.652073:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046592 00000100:00100000:1.0:1783947409.652091:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046592 00000100:00100000:1.0:1783947409.652143:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947409.652153:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236046592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947409.654254:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947409.654381:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236046592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2225us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947409.654390:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1783947409.654724:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0700 x1870604236046592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947409.654748:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236046592:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783947410.611601:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947411.188742:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947411.188780:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236046720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947411.188859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947411.188932:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046720 00000100:00100000:2.0:1783947411.189101:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046720 00000100:00100000:2.0:1783947411.189153:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947411.189161:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236046720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947411.189197:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947411.189248:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236046720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947411.189256:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947411.189307:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236046720:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947411.637008:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947412.661093:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947412.723641:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947412.727103:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236046848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947412.727196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947412.727336:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947412.727891:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947412.733071:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046848 00000100:00100000:3.0:1783947412.733090:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046848 00000100:00100000:3.0:1783947412.733190:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236046976 00000100:00100000:3.0:1783947412.733194:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236046976 00000100:00100000:0.0:1783947412.735341:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783947412.735362:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236046848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947412.735399:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947412.735526:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236046848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (8328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947412.735535:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1783947412.735738:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d69880 x1870604236046848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947412.735760:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236046848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783947412.736166:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947412.736378:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947412.736389:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236046976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947412.736407:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947412.736484:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236046976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (8594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947412.736492:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1783947412.736530:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d6aa00 x1870604236046976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947412.736699:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236046976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947413.239006:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236047104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947413.239078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947413.239147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236047104 00000100:00100000:2.0:1783947413.239155:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236047104 00000100:00100000:2.0:1783947413.239198:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783947413.239206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236047104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947413.239243:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947413.239286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236047104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947413.239292:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783947413.239335:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236047104:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783947413.688816:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947414.261346:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947414.261382:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236047232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947414.261482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947414.261549:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236047232 00000100:00100000:0.0:1783947414.261557:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236047232 00000100:00100000:0.0:1783947414.261612:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783947414.261622:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236047232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947414.261658:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947414.261701:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236047232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947414.261707:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1783947414.261749:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5842300 x1870604236047232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947414.261766:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236047232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947414.262233:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236047488:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947414.262293:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236048000:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947414.262329:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236048512:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947414.262372:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783947414.262378:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236047616:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947414.262432:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236048128:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262481:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947414.262500:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236048640:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262518:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947414.262541:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236047488 00000100:00100000:1.0:1783947414.262546:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236047488 00000100:00100000:1.0:1783947414.262570:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048000 00000100:00100000:1.0:1783947414.262573:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048000 00000100:00100000:1.0:1783947414.262586:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048512 00000100:00100000:1.0:1783947414.262588:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048512 00000100:00100000:1.0:1783947414.262600:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048128 00000100:00100000:1.0:1783947414.262602:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048128 00000100:00100000:1.0:1783947414.262612:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048640 00000100:00100000:1.0:1783947414.262615:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048640 00000100:00100000:1.0:1783947414.262629:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783947414.262634:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236047488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262675:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236047488:12345-0@lo:400:kworker.0 Request processed in 39us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.262681:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783947414.262695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783947414.262700:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236048000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262725:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236048000:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.262731:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783947414.262741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783947414.262746:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236048512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262768:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236048512:12345-0@lo:400:kworker.0 Request processed in 21us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.262782:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783947414.262793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783947414.262797:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236048128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262824:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236048128:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.262829:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783947414.262840:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783947414.262846:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236048640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262870:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236048640:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.262875:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783947414.262900:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236047616 00000100:00100000:1.0:1783947414.262903:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236047616 00000100:00100000:1.0:1783947414.262925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783947414.262931:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236047616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.262960:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236047616:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.262965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783947414.262998:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236047616:0@lo:400:kworker.0 00010000:00080000:1.0:1783947414.263010:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b4e00 x1870604236048128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947414.263020:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236048128:0@lo:400:kworker.0 00010000:00080000:1.0:1783947414.263029:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b4a80 x1870604236048640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947414.263048:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236048640:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.263060:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236047488:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.263067:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236048000:0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.263075:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236048512:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263342:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236047744:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947414.263411:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236048256:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947414.263481:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236048768:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947414.263523:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783947414.263530:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236047360:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263556:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947414.263579:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236047872:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263599:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947414.263614:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236048384:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947414.263656:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947414.263660:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947414.263663:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947414.263673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236047872 00000100:00100000:2.0:1783947414.263676:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236047872 00000100:00100000:2.0:1783947414.263706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783947414.263713:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236047872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263751:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236047872:12345-0@lo:400:kworker.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947414.263757:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783947414.263774:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048256 00000100:00100000:2.0:1783947414.263777:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048256 00000100:00100000:2.0:1783947414.263803:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048768 00000100:00100000:2.0:1783947414.263812:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048768 00000100:00100000:2.0:1783947414.263835:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048384 00000100:00100000:2.0:1783947414.263837:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048384 00000100:00100000:2.0:1783947414.263851:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783947414.263856:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236048256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263887:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236048256:12345-0@lo:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947414.263892:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783947414.263903:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947414.263909:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236048768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263934:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236048768:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947414.263939:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947414.263950:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947414.263955:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236048384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.263978:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236048384:12345-0@lo:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947414.263983:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947414.264000:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236047360 00000100:00100000:2.0:1783947414.264003:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236047360 00000100:00100000:2.0:1783947414.264041:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783947414.264048:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236047360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.264077:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236047360:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947414.264082:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783947414.264122:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236047360:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.264224:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236047872:0@lo:400:kworker.0 00010000:00080000:2.0:1783947414.264239:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b6a00 x1870604236048384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947414.264248:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236048384:0@lo:400:kworker.0 00010000:00080000:2.0:1783947414.264256:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b5c00 x1870604236048256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947414.264263:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236048256:0@lo:400:kworker.0 00010000:00080000:2.0:1783947414.264272:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b5f80 x1870604236048768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947414.264281:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236048768:0@lo:400:kworker.0 00000100:00080000:2.0:1783947414.264305:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947414.264307:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947414.264551:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236047744 00000100:00100000:1.0:1783947414.264555:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236047744 00000100:00100000:1.0:1783947414.264592:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783947414.264599:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236047744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947414.264639:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236047744:12345-0@lo:400:kworker.0 Request processed in 41us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.264645:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783947414.264787:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236047744:0@lo:400:kworker.0 00000100:00100000:2.0:1783947414.504030:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947414.504078:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947414.504125:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947414.504158:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954560 00000100:00100000:2.0:1783947414.504169:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954560 00000100:00100000:2.0:1783947414.504221:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 285 00000100:00100000:2.0:1783947414.504231:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2406:x1870604213954560:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947414.504299:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2406:x1870604213954560:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947414.504307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 285 00000100:00100000:2.0:1783947414.504428:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954688 00000100:00100000:2.0:1783947414.504432:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954688 00000100:00100000:2.0:1783947414.504487:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954816 00000100:00100000:2.0:1783947414.504490:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954816 00000100:00100000:2.0:1783947414.504865:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:2.0:1783947414.504884:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213954688:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947414.504920:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213954688:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 47us (899us total) trans 0 rc 0/0 00000100:00080000:3.0:1783947414.506847:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947414.506857:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947414.511628:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:0.0:1783947414.511652:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213954816:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947414.511747:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213954816:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 105us (7621us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947414.511755:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:2.0:1783947414.511961:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 121 00010000:00010000:2.0:1783947414.707767:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947414.775733:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947414.784246:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236048896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947414.784325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947414.785707:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236048896 00000100:00100000:1.0:1783947414.785718:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236048896 00000100:00100000:1.0:1783947414.785781:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783947414.785791:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236048896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947414.785818:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947414.785885:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236048896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947414.785892:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1783947414.785933:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b5180 x1870604236048896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947414.785954:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236048896:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947415.731731:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947416.307675:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236049024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947416.307776:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947416.307909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049024 00000100:00100000:3.0:1783947416.307925:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049024 00000100:00100000:3.0:1783947416.307978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783947416.307988:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236049024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947416.308023:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783947416.314080:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236049024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6079us (6290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947416.314096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783947416.314335:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236049024:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947416.755793:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947417.445545:0:11988:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:56:54 (1783947414) === 00010000:00010000:1.0:1783947417.779646:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947417.844032:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236049152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947417.844128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947417.844601:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947417.844612:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236049280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947417.844642:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947417.844689:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049152 00000100:00100000:0.0:1783947417.844696:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049152 00000100:00100000:0.0:1783947417.844738:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049280 00000100:00100000:0.0:1783947417.844741:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049280 00000100:00100000:0.0:1783947417.844757:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947417.844764:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236049152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947417.844793:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947417.844836:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236049152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947417.844844:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947417.844860:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783947417.844867:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236049280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947417.844890:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947417.844917:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236049280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947417.844924:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1783947417.844956:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cdca80 x1870604236049280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947417.844975:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236049280:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783947417.845003:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d6b480 x1870604236049152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947417.845016:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236049152:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783947417.847033:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947417.947641:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947417.949185:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213954944 00000100:00100000:1.0:1783947417.949200:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213954944 00000100:00100000:1.0:1783947417.949272:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 286 00000100:00100000:1.0:1783947417.949282:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:8730:x1870604213954944:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783947417.949302:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947417.949334:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439a00/0xe6fd1fdb5550022d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3dac expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947417.949362:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439a00/0xe6fd1fdb5550022d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3dac expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947417.949375:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439a00/0xe6fd1fdb5550022d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3dac expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947417.949385:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439a00, rc 0) 00000100:00100000:1.0:1783947417.949453:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8730:x1870604213954944:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 172us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947417.949511:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 286 00000100:00100000:1.0:1783947417.954793:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947417.954954:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955072 00000100:00100000:3.0:1783947417.954972:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955072 00000100:00100000:3.0:1783947417.955059:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 287 00000100:00100000:3.0:1783947417.955072:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8730:x1870604213955072:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783947417.955310:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8730:x1870604213955072:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 240us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947417.955329:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 287 00000100:00100000:3.0:1783947417.958701:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947417.966515:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955200 00000100:00100000:1.0:1783947417.966530:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955200 00000100:00100000:2.0:1783947417.967687:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 288 00000100:00100000:2.0:1783947417.967699:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8730:x1870604213955200:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947417.968370:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8730:x1870604213955200:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 668us (9676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947417.968384:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 288 00000100:00100000:0.0:1783947417.972653:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947417.972746:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955328 00000100:00100000:2.0:1783947417.972762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955328 00000100:00100000:2.0:1783947417.972834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 289 00000100:00100000:2.0:1783947417.972844:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8734:x1870604213955328:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947417.973137:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8734:x1870604213955328:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 293us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947417.973145:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 289 00000100:00100000:0.0:1783947418.025517:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947418.029826:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955456 00000100:00100000:2.0:1783947418.029842:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955456 00000100:00100000:2.0:1783947418.030002:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:2.0:1783947418.030013:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8734:x1870604213955456:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947418.030182:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8734:x1870604213955456:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 170us (4674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.030190:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:0.0:1783947418.039723:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947418.040371:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955584 00000100:00100000:3.0:1783947418.040382:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955584 00000100:00100000:3.0:1783947418.040445:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00100000:3.0:1783947418.040650:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8734:x1870604213955584:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783947418.040933:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8734:x1870604213955584:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 478us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947418.040951:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00100000:0.0:1783947418.045397:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947418.045906:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955712 00000100:00100000:2.0:1783947418.045917:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955712 00000100:00100000:2.0:1783947418.046084:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 292 00000100:00100000:2.0:1783947418.046095:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:8730:x1870604213955712:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947418.046114:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947418.046131:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb55500234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ddd expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947418.046161:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb55500234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ddd expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947418.046173:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb55500234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ddd expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947418.046182:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ea00, rc 0) 00000100:00100000:2.0:1783947418.046246:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:8730:x1870604213955712:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 153us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.046254:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 292 00000100:00100000:0.0:1783947418.051792:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947418.052925:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955840 00000100:00100000:3.0:1783947418.053007:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955840 00000100:00100000:3.0:1783947418.053085:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 293 00000100:00100000:3.0:1783947418.053095:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:8730:x1870604213955840:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783947418.053123:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783947418.053151:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783947418.053155:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783947418.053159:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783947418.053162:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783947418.053164:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1783947418.062995:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:8730:x1870604213955840:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 9888us (11201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947418.063011:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 293 00000100:00100000:0.0:1783947418.066505:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947418.066641:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213955968 00000100:00100000:2.0:1783947418.066650:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213955968 00000100:00100000:2.0:1783947418.066707:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 294 00000100:00100000:2.0:1783947418.066717:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:8730:x1870604213955968:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947418.066761:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947418.066780:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3de4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947418.066818:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947418.066831:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947418.066841:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f400, rc 0) 00000100:00100000:2.0:1783947418.066905:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8730:x1870604213955968:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 189us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.066913:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 294 00000100:00100000:0.0:1783947418.069187:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947418.069331:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956096 00000100:00100000:3.0:1783947418.069341:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956096 00000100:00100000:3.0:1783947418.069398:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 295 00000100:00100000:3.0:1783947418.069408:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8730:x1870604213956096:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783947418.069586:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8730:x1870604213956096:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 179us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947418.069595:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 295 00000100:00100000:0.0:1783947418.080314:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947418.080637:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956224 00000100:00100000:3.0:1783947418.080647:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956224 00000100:00100000:3.0:1783947418.080706:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 296 00000100:00100000:3.0:1783947418.080717:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8730:x1870604213956224:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783947418.080900:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8730:x1870604213956224:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 184us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947418.080908:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 296 00000100:00100000:0.0:1783947418.084703:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947418.085118:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956352 00000100:00100000:2.0:1783947418.085130:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956352 00000100:00100000:2.0:1783947418.085184:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 297 00000100:00100000:2.0:1783947418.085193:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8738:x1870604213956352:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947418.085367:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8738:x1870604213956352:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 174us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.085375:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 297 00000100:00100000:0.0:1783947418.087682:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947418.087785:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956480 00000100:00100000:2.0:1783947418.087794:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956480 00000100:00100000:2.0:1783947418.087861:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 298 00000100:00100000:2.0:1783947418.087871:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8738:x1870604213956480:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947418.088875:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:8738:x1870604213956480:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 1000us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.088894:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 298 00000100:00100000:0.0:1783947418.093698:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947418.093740:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947418.093774:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947418.093957:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956736 00000100:00100000:1.0:1783947418.093969:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956736 00000100:00100000:1.0:1783947418.094036:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956864 00000100:00100000:1.0:1783947418.094039:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956864 00000100:00100000:1.0:1783947418.094070:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956608 00000100:00100000:1.0:1783947418.094073:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956608 00000100:00100000:1.0:1783947418.094086:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:1.0:1783947418.094096:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213956736:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947418.094169:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213956736:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 74us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947418.094177:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:1.0:1783947418.094193:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:1.0:1783947418.094200:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213956864:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947418.094224:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213956864:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947418.094230:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:1.0:1783947418.094241:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:1.0:1783947418.094246:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1870604213956608:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783947418.094266:0:8291:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b25d4884-3548-4434-8d96-3aed90ce07dc@192.168.204.3@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1783947418.094298:0:8291:0:(genops.c:1406:class_connect()) connect: client b25d4884-3548-4434-8d96-3aed90ce07dc, cookie 0xe6fd1fdb55500242 00000004:00100000:1.0:1783947418.094334:0:8291:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783947418.094486:0:8291:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7c01000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947418.094517:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2405:x1870604213956608:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 269us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947418.094523:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00080000:1.0:1783947418.094542:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947418.094546:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947418.095281:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947418.097841:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213957120 00000100:00100000:3.0:1783947418.097857:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213957120 00000100:00100000:3.0:1783947418.097902:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1783947418.097911:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1870604213957120:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783947418.098206:0:6512:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from b25d4884-3548-4434-8d96-3aed90ce07dc@192.168.204.3@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:3.0:1783947418.098250:0:6512:0:(genops.c:1406:class_connect()) connect: client b25d4884-3548-4434-8d96-3aed90ce07dc, cookie 0xe6fd1fdb55500249 00000004:00100000:3.0:1783947418.098276:0:6512:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783947418.098419:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77cd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947418.098541:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2405:x1870604213957120:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 630us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947418.098550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1783947418.116080:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947418.116126:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947418.116161:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947418.116252:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213956992 00000100:00100000:0.0:1783947418.116261:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213956992 00000100:00100000:0.0:1783947418.116335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213957248 00000100:00100000:0.0:1783947418.116338:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213957248 00000100:00100000:0.0:1783947418.116352:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213957376 00000100:00100000:0.0:1783947418.116354:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213957376 00000100:00100000:0.0:1783947418.116367:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:0.0:1783947418.116375:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+7:0:x1870604213956992:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783947418.116416:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947418.116521:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+7:0:x1870604213956992:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 147us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947418.116528:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:0.0:1783947418.116544:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1783947418.116550:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:0:x1870604213957248:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783947418.116566:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947418.116597:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:0:x1870604213957248:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 47us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947418.116618:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1783947418.116633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:0.0:1783947418.116639:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213957376:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783947418.116650:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947418.116672:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213957376:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 33us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947418.116677:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00080000:3.0:1783947418.116902:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947418.116906:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947418.127864:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947418.128043:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213957504 00000100:00100000:0.0:1783947418.128053:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213957504 00000100:00100000:0.0:1783947418.128113:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1783947418.128124:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213957504:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783947418.128217:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213957504:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 95us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947418.128225:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:1.0:1783947418.131612:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947418.132722:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947418.132858:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947418.132922:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213957632 00000100:00100000:2.0:1783947418.132949:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213957632 00000100:00100000:3.0:1783947418.132964:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213957760 00000100:00100000:3.0:1783947418.132975:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213957760 00000100:00100000:2.0:1783947418.133020:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:2.0:1783947418.133031:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604213957632:12345-192.168.204.3@tcp:8:mount.lustre.0 00000100:00100000:3.0:1783947418.133039:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:3.0:1783947418.133050:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2405:x1870604213957760:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783947418.133071:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b25d4884-3548-4434-8d96-3aed90ce07dc@192.168.204.3@tcp t0 exp 0000000000000000 cur 303 last 0 00010000:00080000:3.0:1783947418.133090:0:10351:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from b25d4884-3548-4434-8d96-3aed90ce07dc@192.168.204.3@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:2.0:1783947418.133112:0:8427:0:(genops.c:1406:class_connect()) connect: client b25d4884-3548-4434-8d96-3aed90ce07dc, cookie 0xe6fd1fdb55500250 00002000:00100000:2.0:1783947418.133126:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b25d4884-3548-4434-8d96-3aed90ce07dc/ffff9e7ac674f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1783947418.133135:0:10351:0:(genops.c:1406:class_connect()) connect: client b25d4884-3548-4434-8d96-3aed90ce07dc, cookie 0xe6fd1fdb55500257 00002000:00100000:2.0:1783947418.133139:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1783947418.133150:0:10351:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b25d4884-3548-4434-8d96-3aed90ce07dc/ffff9e7ac77cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783947418.133174:0:10351:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783947418.133232:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:3.0:1783947418.133263:0:10351:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783947418.133282:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e7ac6748800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1783947418.133299:0:10351:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77c8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947418.133384:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2405:x1870604213957632:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 351us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947418.133394:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2405:x1870604213957760:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 338us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.133405:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1783947418.133417:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1783947418.134910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213957888 00000100:00100000:0.0:1783947418.134921:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213957888 00000100:00100000:0.0:1783947418.134990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1783947418.134998:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213957888:12345-192.168.204.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783947418.135077:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213957888:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 79us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947418.135085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1783947418.138023:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947418.138588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958016 00000100:00100000:2.0:1783947418.138616:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958016 00000100:00100000:2.0:1783947418.138699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1783947418.138711:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213958016:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783947418.139552:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783947418.139659:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:8730:x1870604213958016:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 950us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.139668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:1.0:1783947418.355792:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947418.355822:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236049408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947418.355927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947418.356127:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049408 00000100:00100000:2.0:1783947418.356137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049408 00000100:00100000:2.0:1783947418.356197:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783947418.356221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236049408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947418.356251:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947418.356310:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236049408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947418.356326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783947418.356581:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236049408:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783947418.805989:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947419.380546:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236049536:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.380610:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236049664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386435:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236050176:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386584:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236050688:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386649:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236051200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947419.386700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386732:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783947419.386740:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236050048:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386794:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236050560:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386841:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236051072:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386861:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386903:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236049792:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386951:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236050304:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.386973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.386993:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236050816:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.387331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.387359:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783947419.387368:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236049920:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.387400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.387413:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236050432:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.387433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.387480:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236050944:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.387522:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947419.387583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049664 00000100:00100000:0.0:1783947419.387594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049664 00000100:00100000:0.0:1783947419.387649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050176 00000100:00100000:0.0:1783947419.387653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050176 00000100:00100000:0.0:1783947419.387679:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050688 00000100:00100000:0.0:1783947419.387682:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050688 00000100:00100000:0.0:1783947419.387698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050304 00000100:00100000:0.0:1783947419.387701:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050304 00000100:00100000:0.0:1783947419.387713:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050816 00000100:00100000:0.0:1783947419.387716:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050816 00000100:00100000:0.0:1783947419.387727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049920 00000100:00100000:0.0:1783947419.387730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049920 00000100:00100000:0.0:1783947419.387744:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783947419.387754:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236049664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.387827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236049664:12345-0@lo:400:kworker.0 Request processed in 73us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947419.387835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783947419.387854:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783947419.387860:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236050176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.387890:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236050176:12345-0@lo:400:kworker.0 Request processed in 30us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947419.387895:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783947419.387905:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783947419.387910:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236050688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.387936:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236050688:12345-0@lo:400:kworker.0 Request processed in 26us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947419.387941:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783947419.387960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783947419.387965:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236050304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.388003:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236050304:12345-0@lo:400:kworker.0 Request processed in 37us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947419.388008:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783947419.388489:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783947419.388501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236050816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.388552:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236050816:12345-0@lo:400:kworker.0 Request processed in 54us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947419.388767:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783947419.388786:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947419.388793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236049920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.389488:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236049920:12345-0@lo:400:kworker.0 Request processed in 690us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947419.389498:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947419.390086:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051200 00000100:00100000:0.0:1783947419.390097:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051200 00000100:00100000:0.0:1783947419.390164:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783947419.390173:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236051200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947419.390200:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947419.390901:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236051200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 726us (4197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947419.390912:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783947419.390945:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050048 00000100:00100000:0.0:1783947419.390951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050048 00000100:00100000:0.0:1783947419.391035:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049792 00000100:00100000:0.0:1783947419.391053:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049792 00000100:00100000:1.0:1783947419.392773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947419.394755:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236049536 00000100:00100000:1.0:1783947419.394776:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236049536 00000100:00100000:1.0:1783947419.394932:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1783947419.394944:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236049536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947419.395075:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236049536:12345-0@lo:400:kworker.0 Request processed in 134us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947419.395085:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1783947419.395166:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236049536:0@lo:400:kworker.0 00000100:00100000:1.0:1783947419.396772:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050560 00000100:00100000:1.0:1783947419.397400:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050560 00000100:00100000:1.0:1783947419.397507:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051072 00000100:00100000:1.0:1783947419.397511:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051072 00000100:00100000:1.0:1783947419.398261:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050432 00000100:00100000:1.0:1783947419.398269:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050432 00000100:00100000:3.0:1783947419.398366:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783947419.398384:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236050048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947419.398429:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236050944 00000100:00100000:1.0:1783947419.398434:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236050944 00000100:00100000:1.0:1783947419.398477:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783947419.398485:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236050560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947419.398542:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236050048:12345-0@lo:400:kworker.0 Request processed in 165us (11770us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947419.398551:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783947419.398591:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783947419.398600:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236049792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947419.398637:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236049792:12345-0@lo:400:kworker.0 Request processed in 39us (11706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947419.398643:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947419.398776:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236050560:12345-0@lo:400:kworker.0 Request processed in 292us (11954us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947419.398924:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783947419.398937:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236051072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947419.398979:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236051072:12345-0@lo:400:kworker.0 Request processed in 48us (12118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947419.398985:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783947419.398999:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783947419.399004:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236050432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947419.399032:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236050432:12345-0@lo:400:kworker.0 Request processed in 27us (11597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947419.399038:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783947419.399050:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783947419.399056:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236050944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947419.399086:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236050944:12345-0@lo:400:kworker.0 Request processed in 30us (11562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947419.399090:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947419.399197:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1783947419.399724:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947419.399731:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947419.399736:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947419.399740:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947419.402088:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236049920:0@lo:400:kworker.0 00010000:00080000:0.0:1783947419.402436:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77efb80 x1870604236050432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947419.402450:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236050432:0@lo:400:kworker.0 00010000:00080000:0.0:1783947419.402499:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ee300 x1870604236050944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947419.402508:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236050944:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.402523:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236049792:0@lo:400:kworker.0 00010000:00080000:0.0:1783947419.402536:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77edf80 x1870604236050304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947419.402543:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236050304:0@lo:400:kworker.0 00010000:00080000:0.0:1783947419.402628:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77eca80 x1870604236050816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947419.402637:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236050816:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.406268:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236050048:0@lo:400:kworker.0 00010000:00080000:0.0:1783947419.406377:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77eed80 x1870604236050560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947419.406390:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236050560:0@lo:400:kworker.0 00010000:00080000:0.0:1783947419.406408:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ec700 x1870604236051072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947419.406417:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236051072:0@lo:400:kworker.0 00010000:00080000:0.0:1783947419.406496:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d69880 x1870604236051200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947419.406522:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236051200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947419.406540:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236049664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.407360:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236050176:0@lo:400:kworker.0 00000100:00100000:0.0:1783947419.407394:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236050688:0@lo:400:kworker.0 00010000:00010000:2.0:1783947419.839093:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947419.892663:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236051328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947419.892785:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947419.892892:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051328 00000100:00100000:1.0:1783947419.892903:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051328 00000100:00100000:1.0:1783947419.892974:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947419.892987:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236051328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947419.893036:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947419.893093:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236051328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947419.893103:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1783947419.893161:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b4380 x1870604236051328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947419.893187:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236051328:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783947420.855123:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947421.435158:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947421.435202:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236051456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947421.435311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947421.435438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051456 00000100:00100000:2.0:1783947421.435448:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051456 00000100:00100000:2.0:1783947421.435550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783947421.435562:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236051456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947421.435953:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947421.436029:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236051456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 468us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947421.436038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783947421.436107:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236051456:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947421.876515:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947422.902367:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947422.963981:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236051712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947422.964087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947422.964168:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051712 00000100:00100000:3.0:1783947422.964183:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051712 00000100:00100000:0.0:1783947422.964191:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947422.964201:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236051584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947422.964250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783947422.964267:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947422.964515:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051584 00000100:00100000:3.0:1783947422.964519:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051584 00000100:00100000:3.0:1783947422.964563:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947422.964574:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236051712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947422.965013:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783947422.965047:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947422.965104:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236051712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 531us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947422.965113:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947422.965135:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783947422.965144:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236051584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947422.965157:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947422.965213:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236051584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947422.965221:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1783947422.965267:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c6d180 x1870604236051584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947422.965292:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236051584:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783947422.965307:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d69880 x1870604236051712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947422.965320:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236051712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947423.213478:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947423.213526:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947423.213552:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947423.213579:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947423.213606:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947423.213754:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958144 00000100:00100000:0.0:1783947423.213789:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958144 00000100:00100000:0.0:1783947423.213859:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 300 00000100:00100000:0.0:1783947423.213871:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213958144:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947423.213992:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213958144:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 122us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.214001:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 300 00000100:00100000:0.0:1783947423.214046:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958400 00000100:00100000:0.0:1783947423.214050:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958400 00000100:00100000:0.0:1783947423.214091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958656 00000100:00100000:0.0:1783947423.214095:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958656 00000100:00100000:0.0:1783947423.214108:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958272 00000100:00100000:0.0:1783947423.214110:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958272 00000100:00100000:0.0:1783947423.214125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:0.0:1783947423.214131:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213958400:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947423.214163:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213958400:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.214170:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:0.0:1783947423.214180:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:0.0:1783947423.214185:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958656:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947423.214205:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958656:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 20us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.214211:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:0.0:1783947423.214234:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:0.0:1783947423.214241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213958272:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947423.214279:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213958272:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 39us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.214285:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00080000:0.0:1783947423.214311:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947423.214324:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947423.214989:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947423.215333:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947423.215492:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958912 00000100:00100000:1.0:1783947423.215501:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958912 00000100:00100000:1.0:1783947423.215558:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958784 00000100:00100000:1.0:1783947423.215562:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958784 00000100:00100000:1.0:1783947423.215587:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1783947423.215597:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958912:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947423.215954:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213958528 00000100:00100000:0.0:1783947423.215960:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213958528 00000100:00100000:0.0:1783947423.215997:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:0.0:1783947423.216006:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958528:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947423.216079:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958528:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 75us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.216088:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:1.0:1783947423.216295:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958912:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 700us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947423.216304:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1783947423.216322:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:1.0:1783947423.216329:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958784:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947423.216356:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2406:x1870604213958784:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947423.216362:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00080000:1.0:1783947423.216424:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947423.216430:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947423.216433:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947423.479673:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947423.479710:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236051840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947423.479810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947423.481389:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051840 00000100:00100000:0.0:1783947423.481407:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051840 00000100:00100000:0.0:1783947423.481507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783947423.481518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236051840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947423.481581:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947423.481687:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236051840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947423.481695:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783947423.481956:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236051840:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1783947423.487079:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00100000:0.0:1783947423.487780:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00100000:3.0:1783947423.489184:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00100000:0.0:1783947423.494744:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00010000:00010000:1.0:1783947423.929317:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947424.144880:0:12181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1783947424.499840:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236052352:0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.499840:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236052224:0@lo:400:kworker.0 00000100:00100000:2.0:1783947424.499928:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236051968:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.500077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947424.500149:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236052864:0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.500156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947424.500183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947424.500188:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236052736:0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.500235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947424.500243:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236053376:0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.500260:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236053248:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.500276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947424.500309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947424.500319:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236052096:0@lo:400:kworker.0 00000100:00100000:3.0:1783947424.500373:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052352 00000100:00100000:3.0:1783947424.500381:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052352 00000100:00100000:3.0:1783947424.500428:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052736 00000100:00100000:3.0:1783947424.500432:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052736 00000100:00100000:0.0:1783947424.500436:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052224 00000100:00100000:0.0:1783947424.500442:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052224 00000100:00100000:3.0:1783947424.500480:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236053248 00000100:00100000:3.0:1783947424.500484:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236053248 00000100:00100000:0.0:1783947424.500505:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783947424.500509:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783947424.500518:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5df2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236052224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947424.500521:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236052352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947424.500588:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236052352:12345-0@lo:400:kworker.0 Request processed in 71us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947424.500595:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783947424.500612:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783947424.500618:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236052736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.500791:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5df2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236052224:12345-0@lo:400:kworker.0 Request processed in 277us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.500799:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783947424.500885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947424.500923:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236052480:0@lo:400:kworker.0 00000100:00100000:2.0:1783947424.500999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947424.501025:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236052992:0@lo:400:kworker.0 00000100:00100000:2.0:1783947424.501052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947424.501076:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236053504:0@lo:400:kworker.0 00000100:00100000:2.0:1783947424.501102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947424.501147:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783947424.501157:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236053248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.501165:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052480 00000100:00100000:0.0:1783947424.501171:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052480 00000100:00100000:0.0:1783947424.501206:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783947424.501214:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236052480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.501258:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236052480:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.501265:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783947424.501270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947424.501287:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783947424.501291:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236052608:0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.501297:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1783947424.501316:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783947424.501323:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947424.501335:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236053120:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.501352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947424.501362:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236053632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947424.501382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947424.501398:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052096 00000100:00100000:0.0:1783947424.501403:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052096 00000100:00100000:1.0:1783947424.501421:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052864 00000100:00100000:0.0:1783947424.501424:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783947424.501427:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052864 00000100:00100000:0.0:1783947424.501431:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052608 00000100:00100000:0.0:1783947424.501436:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052608 00000100:00100000:0.0:1783947424.501473:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783947424.501478:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236053120 00000100:00100000:0.0:1783947424.501481:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236053120 00000100:00100000:1.0:1783947424.501492:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236053376 00000100:00100000:1.0:1783947424.501496:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236053376 00000100:00100000:0.0:1783947424.501498:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783947424.501507:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783947424.501515:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236052096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.501518:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236052992 00000100:00100000:1.0:1783947424.501522:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236052992 00000100:00100000:1.0:1783947424.501538:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236053504 00000100:00100000:1.0:1783947424.501542:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236053504 00000100:00100000:1.0:1783947424.501565:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783947424.501574:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236052864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.501613:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236052864:12345-0@lo:400:kworker.0 Request processed in 41us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947424.501619:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783947424.501632:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783947424.501637:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236053376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.501667:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236053376:12345-0@lo:400:kworker.0 Request processed in 29us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947424.501683:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783947424.501753:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236052096:12345-0@lo:400:kworker.0 Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.501762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783947424.501775:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783947424.501781:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783947424.501786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236052608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.501817:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236052608:12345-0@lo:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.501823:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783947424.501832:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783947424.501837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783947424.501843:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236053120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947424.501866:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236053120:12345-0@lo:400:kworker.0 Request processed in 23us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947424.501871:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783947424.503120:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236052736:12345-0@lo:400:kworker.0 Request processed in 2491us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947424.503134:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783947424.504508:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783947424.504532:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236052992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.504626:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236052992:12345-0@lo:400:kworker.0 Request processed in 106us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947424.504633:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783947424.504646:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783947424.504653:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236053504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.504684:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236053504:12345-0@lo:400:kworker.0 Request processed in 31us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947424.504772:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1783947424.504801:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947424.504807:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947424.504810:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947424.504812:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947424.504826:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236051968 00000100:00100000:1.0:1783947424.504834:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236051968 00000100:00100000:1.0:1783947424.504880:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783947424.504887:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236051968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.504921:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236051968:12345-0@lo:400:kworker.0 Request processed in 34us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947424.504927:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1783947424.504986:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236053632 00000100:00100000:1.0:1783947424.504991:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236053632 00000100:00100000:1.0:1783947424.505020:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947424.505027:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236053632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947424.505070:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947424.505107:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236053632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (3724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947424.505114:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947424.505173:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236052352:0@lo:400:kworker.0 00010000:00080000:1.0:1783947424.505208:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7718000 x1870604236052864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947424.505221:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236052864:0@lo:400:kworker.0 00010000:00080000:1.0:1783947424.505235:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac771b800 x1870604236053376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947424.505243:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236053376:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.507152:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236051968:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.507173:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236052480:0@lo:400:kworker.0 00010000:00080000:1.0:1783947424.507188:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac771ad80 x1870604236052992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947424.507208:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236052992:0@lo:400:kworker.0 00010000:00080000:1.0:1783947424.507223:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7718e00 x1870604236053504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947424.507232:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236053504:0@lo:400:kworker.0 00000100:00100000:2.0:1783947424.508279:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236053248:12345-0@lo:400:kworker.0 Request processed in 7121us (7967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947424.508314:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783947424.508541:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236052224:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.508618:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236052096:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.508634:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236052608:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.508658:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236053120:0@lo:400:kworker.0 00010000:00080000:0.0:1783947424.508670:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7718700 x1870604236052736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783947424.508676:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d69880 x1870604236053632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947424.508695:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236052736:0@lo:400:kworker.0 00000100:00100000:1.0:1783947424.508709:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236053632:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783947424.508725:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7719500 x1870604236053248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947424.508735:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236053248:0@lo:400:kworker.0 00010000:00010000:2.0:1783947424.947586:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947425.011784:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236053760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947425.011892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947425.012288:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236053760 00000100:00100000:1.0:1783947425.012310:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236053760 00000100:00100000:1.0:1783947425.012401:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947425.012415:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236053760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947425.012451:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947425.012555:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236053760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947425.012580:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1783947425.012596:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5842a00 x1870604236053760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947425.012629:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236053760:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783947425.977068:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947426.549401:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236053888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947426.549583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947426.549847:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236053888 00000100:00100000:2.0:1783947426.549857:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236053888 00000100:00100000:2.0:1783947426.549924:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947426.549935:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236053888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947426.550000:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947426.550065:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236053888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947426.550072:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783947426.550129:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236053888:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947426.997822:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947428.020658:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947428.084171:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947428.084209:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236054016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947428.084307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947428.085577:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054016 00000100:00100000:0.0:1783947428.085593:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054016 00000100:00100000:0.0:1783947428.085701:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783947428.085717:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236054016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947428.085776:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947428.085870:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236054016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947428.085878:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1783947428.085936:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c6c380 x1870604236054016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947428.085963:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236054016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783947428.086183:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947428.086494:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947428.086510:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236054144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947428.086558:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947428.086636:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054144 00000100:00100000:2.0:1783947428.086642:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054144 00000100:00100000:2.0:1783947428.087366:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1783947428.087367:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947428.087449:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236054144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783947428.087518:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947428.088045:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236054144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 667us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947428.088054:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1783947428.088588:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c6c380 x1870604236054144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947428.088897:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236054144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947428.331060:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947428.331100:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947428.331151:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947428.331187:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947428.331217:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947428.331248:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947428.331309:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947428.331348:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959680 00000100:00100000:0.0:1783947428.331358:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959680 00000100:00100000:2.0:1783947428.331365:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959808 00000100:00100000:2.0:1783947428.331371:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959808 00000100:00100000:2.0:1783947428.331428:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:2.0:1783947428.331440:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959808:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947428.331443:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959168 00000100:00100000:3.0:1783947428.331450:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959168 00000100:00100000:3.0:1783947428.331517:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959424 00000100:00100000:3.0:1783947428.331521:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959424 00000100:00100000:2.0:1783947428.331535:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959808:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947428.331545:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959296 00000100:00100000:3.0:1783947428.331550:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959296 00000100:00100000:2.0:1783947428.331556:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:3.0:1783947428.331569:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959552 00000100:00100000:3.0:1783947428.331572:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959552 00000100:00100000:3.0:1783947428.331610:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:3.0:1783947428.331619:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213959168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947428.331627:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:1.0:1783947428.331646:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947428.331658:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213959168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947428.331667:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:1.0:1783947428.331685:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 41us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947428.331687:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:1.0:1783947428.331698:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:3.0:1783947428.331700:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213959296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947428.331718:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 144 00000100:00100000:1.0:1783947428.331728:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947428.331734:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213959296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 35us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947428.331743:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:1.0:1783947428.331763:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947428.331770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 144 00000100:00100000:0.0:1783947428.333596:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1783947428.333615:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947428.333678:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213959680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 72us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947428.333695:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1783947428.333722:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959040 00000100:00100000:0.0:1783947428.333729:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959040 00000100:00100000:0.0:1783947428.333818:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 302 00000100:00100000:0.0:1783947428.333826:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213959040:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947428.333854:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213959040:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947428.333861:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 302 00000100:00080000:0.0:1783947428.333900:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947428.333906:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947428.333909:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947428.333911:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947428.600881:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947428.600904:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236054272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947428.600974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947428.601033:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054272 00000100:00100000:3.0:1783947428.601040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054272 00000100:00100000:3.0:1783947428.601082:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783947428.601090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236054272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947428.601135:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947428.601188:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236054272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947428.601195:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783947428.601237:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236054272:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783947429.045428:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947429.623441:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236054400:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623575:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236054912:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623717:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236055424:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623759:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236055936:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623805:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783947429.623812:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236054528:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623854:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236055040:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623892:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236055552:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623940:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236054784:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.623962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.623980:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236055296:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.624002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.624019:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236055808:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.624038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.624069:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783947429.624075:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236054656:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.624109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.624127:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236055168:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.624147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.624164:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236055680:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.624182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947429.624205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054912 00000100:00100000:2.0:1783947429.624212:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054912 00000100:00100000:2.0:1783947429.624255:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054656 00000100:00100000:2.0:1783947429.624258:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054656 00000100:00100000:2.0:1783947429.624273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783947429.624281:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236054912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947429.624490:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236056064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947429.624521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947429.624556:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056064 00000100:00100000:0.0:1783947429.624560:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056064 00000100:00100000:0.0:1783947429.624612:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947429.624620:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236056064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947429.624644:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947429.624686:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236056064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947429.624693:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1783947429.624715:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783947429.624744:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc47a1500 x1870604236056064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947429.624763:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236056064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947429.625090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236054912:12345-0@lo:400:kworker.0 Request processed in 808us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947429.625108:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783947429.625123:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783947429.625130:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236054656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.625172:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236054656:12345-0@lo:400:kworker.0 Request processed in 43us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947429.625179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783947429.625198:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055424 00000100:00100000:2.0:1783947429.625202:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055424 00000100:00100000:2.0:1783947429.625227:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055936 00000100:00100000:2.0:1783947429.625230:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055936 00000100:00100000:2.0:1783947429.625240:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055296 00000100:00100000:2.0:1783947429.625242:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055296 00000100:00100000:2.0:1783947429.625252:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055808 00000100:00100000:2.0:1783947429.625261:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055808 00000100:00100000:2.0:1783947429.625283:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783947429.625289:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.625411:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236054656:0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.625550:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947429.625558:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236055936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947429.625765:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236054912:0@lo:400:kworker.0 00000100:00080000:0.0:1783947429.625785:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947429.625960:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054400 00000100:00100000:3.0:1783947429.625965:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054400 00000100:00100000:3.0:1783947429.626001:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1783947429.626008:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236054400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.626671:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236055936:12345-0@lo:400:kworker.0 Request processed in 1111us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.626681:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947429.626702:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947429.626711:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236055296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.626754:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236055296:12345-0@lo:400:kworker.0 Request processed in 45us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.626760:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947429.626771:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783947429.626778:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236055808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.626808:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236055808:12345-0@lo:400:kworker.0 Request processed in 30us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.626824:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783947429.626844:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054528 00000100:00100000:1.0:1783947429.626850:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054528 00000100:00100000:1.0:1783947429.626872:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055040 00000100:00100000:1.0:1783947429.626875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055040 00000100:00100000:1.0:1783947429.626891:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055552 00000100:00100000:1.0:1783947429.626894:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055552 00000100:00100000:1.0:1783947429.626906:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236054784 00000100:00100000:1.0:1783947429.626909:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236054784 00000100:00100000:1.0:1783947429.626921:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055168 00000100:00100000:1.0:1783947429.626923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055168 00000100:00100000:1.0:1783947429.626936:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236055680 00000100:00100000:1.0:1783947429.626939:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236055680 00000100:00100000:1.0:1783947429.626953:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783947429.626958:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236054528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.626994:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236054528:12345-0@lo:400:kworker.0 Request processed in 35us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.627000:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783947429.627013:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947429.627019:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236055040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.627047:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236055040:12345-0@lo:400:kworker.0 Request processed in 28us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.627052:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947429.627063:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783947429.627068:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236055552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.627092:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236055552:12345-0@lo:400:kworker.0 Request processed in 24us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.627108:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783947429.627125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783947429.627131:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236054784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.627160:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236054784:12345-0@lo:400:kworker.0 Request processed in 29us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.627166:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783947429.627176:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783947429.627182:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236055168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.627205:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236055168:12345-0@lo:400:kworker.0 Request processed in 24us (3057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.627211:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783947429.627220:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783947429.627225:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236055680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.627254:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236055680:12345-0@lo:400:kworker.0 Request processed in 29us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947429.627259:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:1.0:1783947429.627326:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c24000 x1870604236055168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947429.627342:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236055168:0@lo:400:kworker.0 00010000:00080000:1.0:1783947429.627356:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c25180 x1870604236055680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947429.627364:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236055680:0@lo:400:kworker.0 00000100:00100000:1.0:1783947429.627376:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236054784:0@lo:400:kworker.0 00010000:00080000:1.0:1783947429.627387:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c26d80 x1870604236055296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947429.627407:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236055296:0@lo:400:kworker.0 00010000:00080000:1.0:1783947429.627421:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c25c00 x1870604236055808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947429.627429:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236055808:0@lo:400:kworker.0 00000100:00080000:0.0:1783947429.627717:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947429.627722:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947429.627748:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236054528:0@lo:400:kworker.0 00000100:00100000:0.0:1783947429.627759:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236055040:0@lo:400:kworker.0 00000100:00100000:0.0:1783947429.627769:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236055552:0@lo:400:kworker.0 00010000:00080000:0.0:1783947429.627781:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c24e00 x1870604236055936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947429.627790:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236055936:0@lo:400:kworker.0 00000100:00100000:2.0:1783947429.628003:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236055424:12345-0@lo:400:kworker.0 Request processed in 2713us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947429.628012:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1783947429.628183:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c24380 x1870604236055424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947429.628194:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236055424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947429.628289:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236054400:12345-0@lo:400:kworker.0 Request processed in 2280us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947429.628298:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1783947429.629501:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236054400:0@lo:400:kworker.0 00010000:00010000:1.0:1783947430.070030:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947430.132157:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947430.132289:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947430.132481:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056192 00000100:00100000:0.0:1783947430.132489:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056192 00000100:00100000:0.0:1783947430.132544:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783947430.132554:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236056192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947430.132589:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947430.132648:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236056192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947430.132656:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1783947430.132681:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7718700 x1870604236056192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947430.132701:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236056192:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947431.092026:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947431.669423:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236056320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947431.671022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947431.671122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056320 00000100:00100000:2.0:1783947431.671132:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056320 00000100:00100000:2.0:1783947431.671195:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783947431.671210:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236056320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947431.671259:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947431.671346:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236056320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947431.671353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783947431.677216:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236056320:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783947432.115723:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783947432.772179:0:12498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947432.772401:0:12498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783947433.139658:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947433.203690:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236056448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947433.203769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947433.203845:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056448 00000100:00100000:0.0:1783947433.203853:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056448 00000100:00100000:0.0:1783947433.203912:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783947433.203923:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236056448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947433.203958:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783947433.203965:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947433.204017:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befbaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236056448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947433.204040:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1783947433.204211:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc47a1500 x1870604236056448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947433.204234:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236056448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947433.207822:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947433.207848:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236056576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947433.207923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947433.207982:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056576 00000100:00100000:0.0:1783947433.207990:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056576 00000100:00100000:0.0:1783947433.208060:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783947433.208071:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236056576:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783947433.208073:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783947433.208100:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947433.208153:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236056576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947433.208161:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1783947433.208203:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc47a0000 x1870604236056576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947433.208223:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236056576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947433.446762:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947433.446794:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947433.446826:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947433.446854:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947433.446874:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947433.446892:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947433.446916:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947433.446943:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960192 00000100:00100000:1.0:1783947433.446954:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960192 00000100:00100000:1.0:1783947433.447007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960448 00000100:00100000:1.0:1783947433.447010:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960448 00000100:00100000:1.0:1783947433.447038:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960064 00000100:00100000:1.0:1783947433.447041:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960064 00000100:00100000:1.0:1783947433.447053:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960320 00000100:00100000:1.0:1783947433.447055:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960320 00000100:00100000:1.0:1783947433.447072:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:1.0:1783947433.447081:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213960192:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947433.447165:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213960192:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.447172:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:1.0:1783947433.447191:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00100000:1.0:1783947433.447197:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960448:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947433.447222:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960448:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.447228:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00100000:1.0:1783947433.447239:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00100000:1.0:1783947433.447246:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213960064:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947433.447268:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213960064:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.447274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00100000:1.0:1783947433.447285:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 154 00000100:00100000:1.0:1783947433.447291:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960320:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947433.447312:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960320:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 22us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.447318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 154 00000100:00100000:1.0:1783947433.447336:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960704 00000100:00100000:1.0:1783947433.447339:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960704 00000100:00100000:1.0:1783947433.447365:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960576 00000100:00100000:1.0:1783947433.447368:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960576 00000100:00100000:1.0:1783947433.447388:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:1.0:1783947433.447394:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960704:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947433.447430:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960704:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 35us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.447436:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:1.0:1783947433.447448:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:1.0:1783947433.447481:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960576:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947433.447506:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213960576:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 52us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947433.447512:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00080000:1.0:1783947433.447538:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947433.447542:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947433.447545:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947433.447546:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947433.447891:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213959936 00000100:00100000:2.0:1783947433.447896:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213959936 00000100:00100000:2.0:1783947433.447939:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 304 00000100:00100000:2.0:1783947433.447946:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213959936:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947433.447989:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213959936:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 44us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947433.447996:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 304 00000100:00100000:1.0:1783947433.718535:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236056704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947433.718627:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947433.722360:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056704 00000100:00100000:3.0:1783947433.722378:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056704 00000100:00100000:3.0:1783947433.722442:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783947433.722480:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236056704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947433.722528:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947433.722620:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236056704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (3993us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947433.722628:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783947433.722696:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236056704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947434.165564:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947434.741040:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947434.741071:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236056832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947434.741169:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947434.741254:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056832 00000100:00100000:3.0:1783947434.741265:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056832 00000100:00100000:3.0:1783947434.741337:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947434.741348:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236056832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947434.741390:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947434.741497:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236056832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947434.741506:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947434.743821:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236056960:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.743911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.743960:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236057472:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.744019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.744042:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236057984:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.744072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.744099:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783947434.744106:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236057088:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.744135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.744155:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236057600:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.744177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.744194:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236058112:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.744216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.744248:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236057344:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.744304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.744326:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236057856:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.744349:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.744377:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236058368:0@lo:400:kworker.0 00000100:00080000:0.0:1783947434.745366:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947434.745468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.745511:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783947434.745635:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236057216:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.745675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.745699:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236057728:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.745723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.745743:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236058240:0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.745766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947434.745802:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236056960 00000100:00100000:2.0:1783947434.745811:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236056960 00000100:00100000:2.0:1783947434.745873:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783947434.745883:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236056960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.745949:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236056960:12345-0@lo:400:kworker.0 Request processed in 68us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947434.745958:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783947434.746010:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057472 00000100:00100000:2.0:1783947434.746015:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057472 00000100:00100000:2.0:1783947434.746044:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057216 00000100:00100000:2.0:1783947434.746047:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057216 00000100:00100000:2.0:1783947434.746062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947434.746068:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236057472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.746112:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236057472:12345-0@lo:400:kworker.0 Request processed in 45us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947434.746118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783947434.746130:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783947434.746136:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236057216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.746182:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236057216:12345-0@lo:400:kworker.0 Request processed in 46us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947434.746188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783947434.746210:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057984 00000100:00100000:2.0:1783947434.746214:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057984 00000100:00100000:2.0:1783947434.746252:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057856 00000100:00100000:2.0:1783947434.746256:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057856 00000100:00100000:2.0:1783947434.746274:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236058368 00000100:00100000:2.0:1783947434.746277:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236058368 00000100:00100000:2.0:1783947434.746306:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783947434.746312:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236057984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.746345:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236057984:12345-0@lo:400:kworker.0 Request processed in 34us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947434.746351:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783947434.746363:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947434.746368:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236057856:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783947434.747258:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d6bb80 x1870604236056832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947434.747289:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236056832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947434.747375:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947434.747390:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236058368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947434.748597:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236057856:12345-0@lo:400:kworker.0 Request processed in 2152us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947434.748613:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947434.748674:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057088 00000100:00100000:2.0:1783947434.748684:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057088 00000100:00100000:2.0:1783947434.748722:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057600 00000100:00100000:2.0:1783947434.748726:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057600 00000100:00100000:2.0:1783947434.748744:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236058112 00000100:00100000:2.0:1783947434.748748:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236058112 00000100:00100000:2.0:1783947434.748763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057344 00000100:00100000:2.0:1783947434.748766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057344 00000100:00100000:2.0:1783947434.748777:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236057728 00000100:00100000:2.0:1783947434.748780:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236057728 00000100:00100000:2.0:1783947434.748807:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236058240 00000100:00100000:2.0:1783947434.748811:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236058240 00000100:00100000:2.0:1783947434.748827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783947434.748834:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236057088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.753645:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236058368:12345-0@lo:400:kworker.0 Request processed in 6245us (8171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947434.753665:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783947434.753731:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947434.753749:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236057600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.753825:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236057600:12345-0@lo:400:kworker.0 Request processed in 85us (9647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947434.753832:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947434.753849:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783947434.753857:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236058112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.753891:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236058112:12345-0@lo:400:kworker.0 Request processed in 36us (9674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947434.753897:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783947434.753913:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783947434.753920:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236057344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.753951:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236057344:12345-0@lo:400:kworker.0 Request processed in 31us (9646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947434.753966:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783947434.753979:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783947434.753986:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236057728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.754035:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236057728:12345-0@lo:400:kworker.0 Request processed in 50us (8310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947434.754041:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783947434.754054:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783947434.754061:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236058240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.754095:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236058240:12345-0@lo:400:kworker.0 Request processed in 34us (8328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947434.754101:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783947434.754225:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236057600:0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.754240:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236058112:0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.754253:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236056960:0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.754269:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236057472:0@lo:400:kworker.0 00010000:00080000:3.0:1783947434.754286:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cdce00 x1870604236057984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947434.754298:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236057984:0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.754359:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236057216:0@lo:400:kworker.0 00010000:00080000:3.0:1783947434.754372:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6409f80 x1870604236057728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947434.754382:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236057728:0@lo:400:kworker.0 00010000:00080000:3.0:1783947434.754405:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cddc00 x1870604236058240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947434.754414:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236058240:0@lo:400:kworker.0 00000100:00100000:3.0:1783947434.754425:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236057344:0@lo:400:kworker.0 00010000:00080000:3.0:1783947434.754438:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cded80 x1870604236057856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947434.754446:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236057856:0@lo:400:kworker.0 00010000:00080000:3.0:1783947434.754493:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cddf80 x1870604236058368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947434.754501:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236058368:0@lo:400:kworker.0 00000100:00080000:3.0:1783947434.754538:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947434.754546:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947434.754550:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947434.759918:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236057088:12345-0@lo:400:kworker.0 Request processed in 11066us (15764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947434.759940:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783947434.761894:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236057088:0@lo:400:kworker.0 00000020:00000004:3.0:1783947434.899763:0:12596:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947434.900736:0:12596:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783947435.196599:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947435.251763:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947435.251831:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236058496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947435.251903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947435.251973:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236058496 00000100:00100000:0.0:1783947435.251983:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236058496 00000100:00100000:0.0:1783947435.252074:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783947435.252084:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236058496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947435.252108:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947435.252164:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236058496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947435.252172:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1783947435.252262:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac771b800 x1870604236058496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947435.252282:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236058496:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783947436.211810:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947436.789752:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947436.789787:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236058624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947436.789890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947436.789992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236058624 00000100:00100000:1.0:1783947436.790002:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236058624 00000100:00100000:1.0:1783947436.790065:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783947436.790077:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236058624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947436.790128:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783947436.790184:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236058624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947436.790192:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783947436.790267:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236058624:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947437.236943:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783947437.276061:0:12693:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947437.276972:0:12693:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947438.261193:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947438.323718:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac646ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236058752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947438.323796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947438.323876:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236058752 00000100:00100000:2.0:1783947438.323886:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236058752 00000100:00100000:2.0:1783947438.323963:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783947438.323973:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236058752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947438.324011:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947438.324066:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236058752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947438.324072:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1783947438.324098:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947438.324129:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac646ed80 x1870604236058752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947438.324164:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac646ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236058752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947438.327410:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236058880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947438.327520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947438.327679:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236058880 00000100:00100000:1.0:1783947438.327689:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236058880 00000100:00100000:1.0:1783947438.327750:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783947438.327760:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236058880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947438.327788:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947438.327841:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236058880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947438.327848:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1783947438.328053:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947438.328089:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc47a0e00 x1870604236058880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947438.328110:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236058880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947438.569190:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947438.569240:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947438.569263:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947438.569279:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947438.569296:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947438.569316:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947438.569342:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947438.569372:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961472 00000100:00100000:1.0:1783947438.569383:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961472 00000100:00100000:1.0:1783947438.569480:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961600 00000100:00100000:1.0:1783947438.569484:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961600 00000100:00100000:1.0:1783947438.569515:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1783947438.569526:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2405:x1870604213961472:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:1.0:1783947438.569560:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500250 00000100:00080000:1.0:1783947438.569570:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e7ac6748800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947438.569617:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783947438.569934:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+2:2405:x1870604213961472:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 397us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947438.569954:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1783947438.569970:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1783947438.569977:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2405:x1870604213961600:12345-192.168.204.3@tcp:9:kworker.0 00000020:00000080:1.0:1783947438.569991:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500257 00000100:00080000:1.0:1783947438.569996:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77c8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947438.570021:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783947438.570095:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+2:2405:x1870604213961600:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 118us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947438.570102:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00080000:1.0:1783947438.570124:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947438.570129:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783947438.570141:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947438.570146:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947438.570272:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960832 00000100:00100000:3.0:1783947438.570277:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960832 00000100:00100000:3.0:1783947438.570321:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 306 00000100:00100000:3.0:1783947438.570328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213960832:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947438.570360:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213960832:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947438.570366:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 306 00000100:00100000:3.0:1783947438.570404:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961088 00000100:00100000:3.0:1783947438.570419:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961088 00000100:00100000:3.0:1783947438.570472:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961344 00000100:00100000:3.0:1783947438.570476:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961344 00000100:00100000:3.0:1783947438.570491:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213960960 00000100:00100000:3.0:1783947438.570493:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213960960 00000100:00100000:3.0:1783947438.570504:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961216 00000100:00100000:3.0:1783947438.570506:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961216 00000100:00100000:3.0:1783947438.570519:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:3.0:1783947438.570524:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213961088:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947438.570553:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213961088:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 29us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947438.570559:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:3.0:1783947438.570570:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:3.0:1783947438.570576:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213961344:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947438.570597:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213961344:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 21us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947438.570603:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:3.0:1783947438.570614:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1783947438.570620:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213960960:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947438.570643:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213960960:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947438.570649:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1783947438.570661:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00100000:3.0:1783947438.570667:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213961216:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947438.570687:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213961216:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 21us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947438.570699:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00080000:1.0:1783947438.571297:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947438.571303:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947438.835749:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947438.835772:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236059008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947438.835842:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947438.839175:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059008 00000100:00100000:3.0:1783947438.839191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059008 00000100:00100000:3.0:1783947438.844082:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783947438.844209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236059008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947438.844256:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947438.844611:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236059008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 512us (8768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947438.844620:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783947438.848544:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236059008:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947439.283722:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783947439.651073:0:12790:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947439.651668:0:12790:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783947439.859754:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236059264:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.859829:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.859885:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236059136:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.859897:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236059776:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.859934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947439.859958:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236060288:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.859985:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947439.860176:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236059520:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860231:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236060800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947439.860260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947439.860282:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783947439.860288:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236059392:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860324:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947439.860344:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236059904:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947439.860528:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236060416:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947439.860599:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059264 00000100:00100000:3.0:1783947439.860608:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059264 00000100:00100000:3.0:1783947439.860649:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059776 00000100:00100000:3.0:1783947439.860653:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059776 00000100:00100000:3.0:1783947439.860676:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060288 00000100:00100000:3.0:1783947439.860679:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060288 00000100:00100000:3.0:1783947439.860690:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059904 00000100:00100000:3.0:1783947439.860692:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059904 00000100:00100000:3.0:1783947439.860704:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060416 00000100:00100000:3.0:1783947439.860706:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060416 00000100:00100000:3.0:1783947439.860721:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783947439.860730:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236059264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860787:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236059264:12345-0@lo:400:kworker.0 Request processed in 57us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.860795:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783947439.860812:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783947439.860818:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236059776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860849:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236059776:12345-0@lo:400:kworker.0 Request processed in 31us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.860855:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783947439.860877:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783947439.860885:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236060288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860925:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236060288:12345-0@lo:400:kworker.0 Request processed in 41us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.860931:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783947439.860943:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783947439.860949:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236059904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.860976:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236059904:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.860988:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783947439.861001:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783947439.861007:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236060416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.861037:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236060416:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.861043:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783947439.861070:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060800 00000100:00100000:3.0:1783947439.861074:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060800 00000100:00100000:3.0:1783947439.861102:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783947439.861109:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236060800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947439.861130:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947439.861161:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236060800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.861167:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783947439.861186:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059392 00000100:00100000:3.0:1783947439.861190:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059392 00000100:00100000:3.0:1783947439.861214:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783947439.861221:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236059392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.861255:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236059392:12345-0@lo:400:kworker.0 Request processed in 35us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.861262:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1783947439.861286:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947439.861291:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947439.861292:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947439.861519:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236059392:0@lo:400:kworker.0 00010000:00080000:3.0:1783947439.861534:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc47a0000 x1870604236059904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947439.861553:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236059904:0@lo:400:kworker.0 00010000:00080000:3.0:1783947439.861566:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd2300 x1870604236060416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947439.861575:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236060416:0@lo:400:kworker.0 00010000:00080000:3.0:1783947439.861585:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb9500 x1870604236060800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947439.861597:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236060800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947439.861608:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236059264:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.861617:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236059776:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.861626:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236060288:0@lo:400:kworker.0 00000100:00100000:2.0:1783947439.862427:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.862555:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236059648:0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.862560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.862594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.862624:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236060160:0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.862633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236060032:0@lo:400:kworker.0 00000100:00100000:2.0:1783947439.862651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947439.862673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.862676:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236060672:0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.862703:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236060544:0@lo:400:kworker.0 00000100:00100000:2.0:1783947439.862711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947439.862738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947439.862768:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059648 00000100:00100000:2.0:1783947439.862775:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059648 00000100:00100000:1.0:1783947439.862782:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060160 00000100:00100000:1.0:1783947439.862788:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060160 00000100:00100000:2.0:1783947439.862828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783947439.862828:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060032 00000100:00100000:2.0:1783947439.862839:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236059648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.862844:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060032 00000100:00100000:1.0:1783947439.862864:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060672 00000100:00100000:0.0:1783947439.863067:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059520 00000100:00100000:0.0:1783947439.863071:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059520 00000100:00100000:0.0:1783947439.863099:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783947439.863106:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236059520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947439.863147:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236059520:12345-0@lo:400:kworker.0 Request processed in 41us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947439.863153:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783947439.863193:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236059520:0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.863264:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060672 00000100:00100000:1.0:1783947439.863284:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060544 00000100:00100000:1.0:1783947439.863286:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060544 00000100:00100000:1.0:1783947439.863482:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783947439.863490:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236060160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.863527:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236060160:12345-0@lo:400:kworker.0 Request processed in 38us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947439.863533:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783947439.863547:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783947439.863553:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236060032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.863583:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236060032:12345-0@lo:400:kworker.0 Request processed in 30us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947439.863589:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783947439.863601:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783947439.863607:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236060672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.863632:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236060672:12345-0@lo:400:kworker.0 Request processed in 25us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947439.863637:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783947439.863646:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947439.863652:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236060544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947439.863676:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236060544:12345-0@lo:400:kworker.0 Request processed in 25us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947439.863682:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947439.863744:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236059648:12345-0@lo:400:kworker.0 Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00080000:0.0:1783947439.863750:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947439.863755:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1783947439.863781:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc47a1500 x1870604236060032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947439.863793:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236060032:0@lo:400:kworker.0 00010000:00080000:0.0:1783947439.863806:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd2a00 x1870604236060544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947439.863815:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236060544:0@lo:400:kworker.0 00000100:00100000:2.0:1783947439.863819:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236059648:0@lo:400:kworker.0 00010000:00080000:2.0:1783947439.863838:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cd1180 x1870604236060160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947439.863848:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236060160:0@lo:400:kworker.0 00010000:00080000:2.0:1783947439.863856:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cbbb80 x1870604236060672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947439.863863:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236060672:0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.866269:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236059136 00000100:00100000:3.0:1783947439.866285:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236059136 00000100:00100000:3.0:1783947439.866351:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1783947439.866361:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236059136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947439.866485:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236059136:12345-0@lo:400:kworker.0 Request processed in 126us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947439.866494:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783947439.866689:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236059136:0@lo:400:kworker.0 00010000:00010000:0.0:1783947440.317609:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947440.373786:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236060928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947440.373879:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947440.374291:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236060928 00000100:00100000:0.0:1783947440.374307:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236060928 00000100:00100000:0.0:1783947440.374359:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783947440.374369:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236060928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947440.374402:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947440.374483:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236060928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947440.374490:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1783947440.374491:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c24700 x1870604236060928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947440.374510:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236060928:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783947441.342979:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783947441.812696:0:12888:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947441.813164:0:12888:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783947441.907960:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947441.912533:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236061056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947441.912655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947441.912857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061056 00000100:00100000:0.0:1783947441.912879:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061056 00000100:00100000:0.0:1783947441.912960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947441.912972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236061056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947441.913028:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947441.913105:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236061056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947441.913113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783947441.913755:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236061056:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783947442.360049:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947443.380578:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947443.444766:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947443.444800:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be78d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236061184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947443.444932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947443.445018:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947443.445029:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236061312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947443.445058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947443.445103:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061184 00000100:00100000:0.0:1783947443.445114:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061184 00000100:00100000:0.0:1783947443.445178:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061312 00000100:00100000:0.0:1783947443.445182:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061312 00000100:00100000:0.0:1783947443.445206:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783947443.445216:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236061184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947443.445258:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947443.445346:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236061184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947443.445356:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783947443.445378:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783947443.445384:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236061312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947443.445396:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947443.445422:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236061312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947443.445428:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1783947443.445449:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947443.445510:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8380 x1870604236061312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947443.445529:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236061312:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1783947443.445555:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7be78d9880 x1870604236061184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947443.445567:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be78d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236061184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947443.694100:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947443.694199:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947443.699099:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947443.699142:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947443.699252:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961728 00000100:00100000:1.0:1783947443.699266:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961728 00000100:00100000:1.0:1783947443.699351:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 308 00000100:00100000:1.0:1783947443.699365:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604213961728:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947443.699496:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604213961728:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 133us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947443.699505:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 308 00000100:00100000:3.0:1783947443.707341:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961856 00000100:00100000:3.0:1783947443.707362:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961856 00000100:00100000:3.0:1783947443.708598:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213962112 00000100:00100000:3.0:1783947443.708609:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213962112 00000100:00100000:3.0:1783947443.708687:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213961984 00000100:00100000:3.0:1783947443.708705:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213961984 00000100:00100000:3.0:1783947443.708733:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:3.0:1783947443.708744:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213962112:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947443.708858:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213962112:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 117us (14658us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947443.708867:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:3.0:1783947443.708885:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 172 00000100:00100000:3.0:1783947443.708892:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213961984:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947443.708915:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213961984:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (9773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947443.708921:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 172 00000100:00080000:1.0:1783947443.708985:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947443.708990:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947443.709081:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947443.709432:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213962240 00000100:00100000:3.0:1783947443.709438:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213962240 00000100:00100000:3.0:1783947443.709509:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00100000:3.0:1783947443.709518:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213962240:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947443.709557:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213962240:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 41us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947443.709564:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00080000:1.0:1783947443.709720:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947443.718047:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 174 00000100:00100000:0.0:1783947443.718065:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213961856:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947443.718186:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213961856:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 126us (24104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947443.718195:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 174 00000100:00080000:1.0:1783947443.718991:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947443.958028:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236061440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947443.958130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947443.959906:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061440 00000100:00100000:2.0:1783947443.959931:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061440 00000100:00100000:2.0:1783947443.960116:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783947443.960155:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236061440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947443.960209:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947443.960326:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236061440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947443.960334:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783947443.960486:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236061440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947444.418754:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947444.979950:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947444.979985:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236061568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947444.980093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947444.980239:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061568 00000100:00100000:0.0:1783947444.980250:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061568 00000100:00100000:0.0:1783947444.980526:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783947444.980560:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236061568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947444.980605:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947444.980669:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236061568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947444.980677:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1783947444.980738:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8380 x1870604236061568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947444.980759:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236061568:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783947444.980844:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947444.981211:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236061952:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.981259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947444.981364:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236062464:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.981396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947444.981418:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236062976:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.981439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947444.981482:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783947444.981488:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236061824:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.981514:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947444.981531:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236062336:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.981552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947444.981691:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062464 00000100:00100000:3.0:1783947444.981710:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062464 00000100:00100000:3.0:1783947444.981763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062976 00000100:00100000:3.0:1783947444.981767:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062976 00000100:00100000:3.0:1783947444.981784:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061824 00000100:00100000:3.0:1783947444.981786:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061824 00000100:00100000:3.0:1783947444.981798:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062336 00000100:00100000:3.0:1783947444.981814:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062336 00000100:00100000:3.0:1783947444.981834:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783947444.981842:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236062464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947444.981895:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236062464:12345-0@lo:400:kworker.0 Request processed in 54us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947444.981901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783947444.981918:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783947444.981923:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236062976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.982128:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236062080:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.982203:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236062848:0@lo:400:kworker.0 00000100:00100000:0.0:1783947444.982488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783947444.982500:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236061824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.984977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947444.985047:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236062592:0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947444.985125:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236063104:0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947444.985207:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783947444.985216:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236061696:0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947444.985276:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236062208:0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947444.985552:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236062720:0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947444.985622:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062592 00000100:00100000:1.0:1783947444.985631:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062592 00000100:00100000:1.0:1783947444.985689:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236063104 00000100:00100000:1.0:1783947444.985692:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236063104 00000100:00100000:1.0:1783947444.985720:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062720 00000100:00100000:1.0:1783947444.985723:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062720 00000100:00100000:1.0:1783947444.985740:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783947444.985749:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236062592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985828:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236062592:12345-0@lo:400:kworker.0 Request processed in 79us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.985836:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783947444.985856:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947444.985862:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236063104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985889:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236063104:12345-0@lo:400:kworker.0 Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.985895:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783947444.985905:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783947444.985911:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236062720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.985937:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236062720:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.985953:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783947444.985981:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061696 00000100:00100000:1.0:1783947444.985985:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061696 00000100:00100000:1.0:1783947444.986027:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1783947444.986034:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236061696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.986067:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236061696:12345-0@lo:400:kworker.0 Request processed in 34us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.986072:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1783947444.986124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236061952 00000100:00100000:1.0:1783947444.986129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236061952 00000100:00100000:1.0:1783947444.986156:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062208 00000100:00100000:1.0:1783947444.986160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062208 00000100:00100000:1.0:1783947444.986174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783947444.986180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236061952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.986216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236061952:12345-0@lo:400:kworker.0 Request processed in 36us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.986222:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783947444.986233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947444.986239:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236062208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.986266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236062208:12345-0@lo:400:kworker.0 Request processed in 28us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.986272:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947444.986523:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236061696:0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.986539:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236062208:0@lo:400:kworker.0 00010000:00080000:1.0:1783947444.986554:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ea300 x1870604236062720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947444.986574:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236062720:0@lo:400:kworker.0 00010000:00080000:1.0:1783947444.986590:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ebb80 x1870604236062592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947444.986600:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236062592:0@lo:400:kworker.0 00010000:00080000:1.0:1783947444.986611:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b5f80 x1870604236063104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947444.986619:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236063104:0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.986689:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062080 00000100:00100000:1.0:1783947444.986694:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062080 00000100:00100000:1.0:1783947444.986721:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783947444.986728:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236062336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.986767:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236062336:12345-0@lo:400:kworker.0 Request processed in 40us (5214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.986774:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783947444.986788:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783947444.986794:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236062080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947444.986837:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236062080:12345-0@lo:400:kworker.0 Request processed in 43us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947444.986843:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783947444.986872:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236062080:0@lo:400:kworker.0 00000100:00080000:1.0:1783947444.987487:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947444.987495:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947444.987500:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1783947444.993748:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00000020:00000080:1.0:1783947444.993759:0:9507:0:(genops.c:906:class_export_put()) final put ffff9e7ac77cd800/b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00100000:1.0:1783947444.994225:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00000020:00000080:1.0:1783947444.994230:0:8421:0:(genops.c:906:class_export_put()) final put ffff9e7ac674f000/b25d4884-3548-4434-8d96-3aed90ce07dc 00000020:00000080:1.0:1783947444.994268:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77cd800/b25d4884-3548-4434-8d96-3aed90ce07dc for lustre-OST0001 00000020:00000080:1.0:1783947444.994333:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac674f000/b25d4884-3548-4434-8d96-3aed90ce07dc for lustre-OST0000 00000020:00000080:1.0:1783947444.994352:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac77c8800 for lustre-OST0001 00000020:00000080:1.0:1783947444.994358:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac6748800 for lustre-OST0000 00000100:00100000:2.0:1783947444.994556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947444.994640:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236061952:0@lo:400:kworker.0 00010000:00080000:2.0:1783947444.994662:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77eb480 x1870604236062464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947444.994674:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236062464:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.994711:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236062336:0@lo:400:kworker.0 00000100:00100000:3.0:1783947444.995171:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236062976:12345-0@lo:400:kworker.0 Request processed in 13243us (13726us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947444.995184:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783947444.995221:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236062848 00000100:00100000:3.0:1783947444.995228:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236062848 00000100:00100000:3.0:1783947444.995294:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783947444.995303:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236062848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947444.995376:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236062848:12345-0@lo:400:kworker.0 Request processed in 74us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947444.995383:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1783947444.995408:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947444.995751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236061824:12345-0@lo:400:kworker.0 Request processed in 13251us (14233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947444.995761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783947444.996256:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236061824:0@lo:400:kworker.0 00000100:00100000:2.0:1783947444.996280:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236062848:0@lo:400:kworker.0 00010000:00080000:2.0:1783947444.996300:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e8700 x1870604236062976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947444.996313:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236062976:0@lo:400:kworker.0 00010000:00010000:2.0:1783947445.428692:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947445.491758:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236063232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947445.491878:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947445.492125:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236063232 00000100:00100000:1.0:1783947445.492135:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236063232 00000100:00100000:3.0:1783947445.492987:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783947445.493023:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236063232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947445.493063:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947445.493138:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236063232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947445.493145:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1783947445.493257:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c24000 x1870604236063232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947445.493284:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236063232:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1783947445.911424:0:13032:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783947446.451918:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947447.028453:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236063360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947447.028590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947447.028723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236063360 00000100:00100000:0.0:1783947447.028734:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236063360 00000100:00100000:0.0:1783947447.028823:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783947447.028836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236063360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947447.028885:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947447.035928:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236063360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7076us (7320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947447.035949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783947447.036839:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236063360:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947447.476878:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947448.499780:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947448.570031:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947448.570069:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236063488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947448.570173:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947448.570568:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236063488 00000100:00100000:3.0:1783947448.570580:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236063488 00000100:00100000:3.0:1783947448.570729:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783947448.570753:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236063488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947448.570798:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947448.570874:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236063488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947448.570882:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1783947448.570917:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947448.571128:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8380 x1870604236063488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947448.571164:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236063488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947448.571640:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236063616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947448.571692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947448.577083:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236063616 00000100:00100000:3.0:1783947448.577107:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236063616 00000100:00100000:3.0:1783947448.577228:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783947448.577260:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236063616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947448.577304:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947448.577423:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236063616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (5730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947448.577431:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1783947448.577477:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947448.577520:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c27100 x1870604236063616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947448.577549:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236063616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947448.820209:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947448.820316:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947448.820350:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947448.820373:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947448.820396:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947448.820432:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213962624 00000100:00100000:1.0:1783947448.820445:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213962624 00000100:00100000:1.0:1783947448.820551:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213962880 00000100:00100000:1.0:1783947448.820555:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213962880 00000100:00100000:1.0:1783947448.820574:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213962496 00000100:00100000:1.0:1783947448.820577:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213962496 00000100:00100000:1.0:1783947448.820590:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213962752 00000100:00100000:1.0:1783947448.820592:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213962752 00000100:00100000:1.0:1783947448.820609:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:1.0:1783947448.820621:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213962624:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947448.820724:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213962624:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 105us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947448.820759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:1.0:1783947448.820780:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:1.0:1783947448.820787:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213962880:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947448.820818:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213962880:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947448.820824:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:1.0:1783947448.820837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:1.0:1783947448.820843:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213962496:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947448.822044:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:0.0:1783947448.822065:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213962752:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947448.822136:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213962752:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 80us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947448.822145:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00080000:0.0:1783947448.822213:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947448.822220:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947448.823072:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213962496:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2219us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947448.823086:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:3.0:1783947448.826761:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213962368 00000100:00100000:3.0:1783947448.826784:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213962368 00000100:00100000:3.0:1783947448.826888:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 310 00000100:00100000:3.0:1783947448.826901:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213962368:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947448.826998:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213962368:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 100us (6803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947448.827007:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 310 00000100:00100000:3.0:1783947449.077185:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236063744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947449.077262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947449.077689:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236063744 00000100:00100000:0.0:1783947449.077697:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236063744 00000100:00100000:0.0:1783947449.077803:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783947449.077815:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236063744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947449.077867:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947449.077943:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236063744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947449.077951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783947449.078531:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236063744:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1783947449.230842:0:13180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca1fb80c0 20000000:00000080:2.0:1783947449.230861:0:13180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7be78f5400 uarg=0000000000000000 20000000:01000000:2.0:1783947449.230904:0:13180:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947449.230910:0:13180:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783947449.230915:0:13180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783947449.234820:0:13181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1783947449.235043:0:13180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783947449.246943:0:13180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783947449.247014:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247042:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247051:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247059:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247068:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247101:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247109:0:13180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247131:0:13180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247197:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247229:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 12 pid: 6503 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.247248:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236063872:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947449.247407:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247416:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 12 pid: 6505 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.247426:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064000:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947449.247522:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.247532:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 23 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.247555:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064128:0@lo:104: 00000100:00100000:2.0:1783947449.247605:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947449.248327:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.248340:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 23 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.248353:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064256:0@lo:104: 00000100:00100000:3.0:1783947449.248391:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236064128 00000100:00100000:2.0:1783947449.248391:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947449.248406:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236064128 00010000:00010000:2.0:1783947449.248441:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.248492:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 23 pid: 6504 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947449.248500:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236064256 00000100:00100000:2.0:1783947449.248506:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064384:0@lo:104: 00000100:00100000:3.0:1783947449.248507:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236064256 00000100:00100000:2.0:1783947449.248536:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947449.248558:0:13180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.248567:0:13180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 23 pid: 6505 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.248575:0:13180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064512:0@lo:104: 00000100:00100000:2.0:1783947449.248596:0:13180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947449.248606:0:13180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947449.248675:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236064384 00000100:00100000:3.0:1783947449.248680:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236064384 00000100:00100000:3.0:1783947449.248693:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236064512 00000100:00100000:3.0:1783947449.248711:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236064512 00000100:00100000:3.0:1783947449.248747:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947449.248759:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:13180:x1870604236064128:12345-0@lo:104: 00010000:00010000:3.0:1783947449.248779:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947449.248828:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947449.248847:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:13180:x1870604236064256:12345-0@lo:104: 00010000:00010000:0.0:1783947449.248864:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.248904:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783947449.248920:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:13180:x1870604236064128:12345-0@lo:104: Request processed in 157us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947449.248928:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1783947449.248941:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783947449.248952:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:13180:x1870604236064256:12345-0@lo:104: Request processed in 111us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947449.248961:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783947449.248971:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947449.249009:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783947449.249016:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:13180:x1870604236064512:12345-0@lo:104: 00010000:00010000:0.0:1783947449.249026:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.249063:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783947449.249068:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:13180:x1870604236064512:12345-0@lo:104: Request processed in 52us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947449.249074:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1783947449.249100:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783947449.249107:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.249127:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c02052800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947449.249132:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.249142:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947449.249149:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947449.249155:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1783947449.249168:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:13180:x1870604236064384:12345-0@lo:104: 00010000:00010000:3.0:1783947449.249181:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.249196:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.249236:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783947449.249243:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:13180:x1870604236064384:12345-0@lo:104: Request processed in 85us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947449.249251:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1783947449.249272:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947449.249279:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783947449.249291:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.249301:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438400 already unused, calling callback (ffffffffc11fcc20) 00010000:00010000:0.0:1783947449.249304:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947449.249307:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.249330:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.249353:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02052800/0xe6fd1fdb55500218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550021f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.249373:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1783947449.249374:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.249382:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947449.249399:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783947449.249401:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c02052200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947449.249410:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.249998:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064128:0@lo:104: 00000100:00100000:2.0:1783947449.250024:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064256:0@lo:104: 00000100:00100000:2.0:1783947449.250033:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064384:0@lo:104: 00000100:00100000:2.0:1783947449.250041:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064512:0@lo:104: 00010000:00010000:0.0:1783947449.250175:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947449.250186:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947449.250191:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783947449.250275:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250282:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783947449.250295:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250303:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02052200/0xe6fd1fdb555001ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555001f5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250319:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947449.250330:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250337:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c02052e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947449.250340:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250348:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947449.250355:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947449.250361:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783947449.250377:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250384:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783947449.250619:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236065024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947449.250738:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250747:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02052e00/0xe6fd1fdb555001fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500203 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.250758:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947449.250760:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947449.250762:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947449.250771:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947449.250795:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236064640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947449.250852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947449.250904:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947449.250918:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236064896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947449.250944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947449.250985:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236064640 00000100:00100000:0.0:1783947449.250992:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236064640 00010000:00010000:0.0:1783947449.251029:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 24 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947449.251057:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236064896 00000100:00100000:0.0:1783947449.251060:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236064896 00010000:00010000:0.0:1783947449.251072:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 25 pid: 6505 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947449.251088:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783947449.251094:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+25:3637:x1870604236064640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947449.251108:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947449.251113:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 25 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.251200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947449.251298:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065024 00000100:00100000:2.0:1783947449.251302:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065024 00010000:00010000:2.0:1783947449.251317:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 26 pid: 6504 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.251332:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947449.251337:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+26:3637:x1870604236064896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947449.251345:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947449.251349:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 26 pid: 6505 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.251360:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 26 pid: 6505 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.251377:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c02053600/0xe6fd1fdb555001f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555001ee expref: 26 pid: 6505 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.251562:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947449.251694:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 25 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.251706:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb5550021f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55500218 expref: 25 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.251715:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947449.251769:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236064896:12345-0@lo:103:ldlm_bl.0 Request processed in 429us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947449.251777:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947449.251796:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783947449.251802:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3639:x1870604236065024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947449.251819:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947449.251824:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 23 pid: 6504 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.251833:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 23 pid: 6504 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.251843:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb55500203 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555001fc expref: 23 pid: 6504 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.251852:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947449.251880:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3639:x1870604236065024:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947449.251887:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783947449.251928:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236065024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947449.252090:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3637:x1870604236064640:12345-0@lo:103:ldlm_bl.0 Request processed in 995us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947449.252097:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947449.252281:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236064896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947449.252293:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236064640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947449.252539:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947449.255351:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.255369:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947449.255408:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.255416:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438400/0xe6fd1fdb5550020a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500211 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947449.255575:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236064768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947449.255768:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947449.255772:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947449.255776:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947449.262493:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947449.262539:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236063872:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947449.263286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947449.263347:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963008 00000100:00100000:1.0:1783947449.263355:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963008 00010000:00010000:1.0:1783947449.263399:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 13 pid: 6503 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947449.263439:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963136 00000100:00100000:1.0:1783947449.263442:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963136 00010000:00010000:1.0:1783947449.263483:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 14 pid: 6505 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947449.264212:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:1.0:1783947449.264225:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45d06cee-8339-4f75-880b-33b7e0c9e5a1+14:2406:x1870604213963008:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947449.264242:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947449.264251:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 14 pid: 6503 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947449.264265:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 14 pid: 6503 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947449.264286:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb5550023b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3de4 expref: 14 pid: 6503 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947449.264302:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947449.264423:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:2.0:1783947449.264434:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213963136:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947449.264444:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947449.264449:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 13 pid: 6505 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.264474:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 13 pid: 6505 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947449.264499:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947449.264804:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3da5 expref: 13 pid: 6505 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947449.264818:0:13180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13180:1870604236064000:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947449.264860:0:13180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947449.271288:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:2406:x1870604213963008:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 7053us (8791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947449.271305:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:0.0:1783947449.273344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947449.273442:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236064768 00000100:00100000:3.0:1783947449.273480:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236064768 00010000:00010000:3.0:1783947449.273531:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 21 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947449.273583:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947449.273592:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc649b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3640:x1870604236064768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947449.273626:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947449.273632:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 21 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273646:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 21 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273666:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439e00/0xe6fd1fdb55500211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550020a expref: 21 pid: 6503 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273683:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273692:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273710:0:7462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273729:0:7462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273736:0:7462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273744:0:7462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273750:0:7462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947449.273756:0:7462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273788:0:7462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273812:0:7462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947449.273824:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947449.273894:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc649b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3640:x1870604236064768:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947449.275615:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236064768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947449.275704:0:13180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.275726:0:13180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947449.275735:0:13180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb5550025e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947449.276222:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:2406:x1870604213963136:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 11776us (12925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947449.277336:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783947449.277467:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00010000:00010000:0.0:1783947449.524874:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947450.099964:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236065280:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.100108:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236065792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.100153:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236066304:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.100212:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1783947450.100218:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236065152:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.100279:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236065664:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.100368:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236066176:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.100412:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236066688:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.100490:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065152 00000100:00100000:3.0:1783947450.100498:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065280 00000100:00100000:1.0:1783947450.100498:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065152 00000100:00100000:3.0:1783947450.100502:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065280 00000100:00100000:3.0:1783947450.100534:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065792 00000100:00100000:3.0:1783947450.100536:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065792 00000100:00100000:1.0:1783947450.100538:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1783947450.100545:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3638:x1870604236065152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947450.100558:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066304 00000100:00100000:3.0:1783947450.100561:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066304 00000100:00100000:3.0:1783947450.100574:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783947450.100579:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236065280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100596:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3638:x1870604236065152:12345-0@lo:400:kworker.0 Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.100603:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1783947450.100611:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236065280:12345-0@lo:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947450.100616:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783947450.100628:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783947450.100633:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236065792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100634:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066176 00000100:00100000:1.0:1783947450.100636:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066176 00000100:00100000:1.0:1783947450.100657:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066688 00000100:00100000:3.0:1783947450.100658:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236065792:12345-0@lo:400:kworker.0 Request processed in 24us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.100660:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066688 00000100:00100000:3.0:1783947450.100663:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783947450.100673:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783947450.100676:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947450.100681:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236066176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947450.100683:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236066304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100720:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236066176:12345-0@lo:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.100726:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947450.100741:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783947450.100747:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236066688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100773:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236066688:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.100787:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783947450.100945:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236065152:0@lo:400:kworker.0 00010000:00080000:1.0:1783947450.100960:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e1f80 x1870604236066176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.100971:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236066176:0@lo:400:kworker.0 00010000:00080000:1.0:1783947450.100981:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7145500 x1870604236066688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.100990:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236066688:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.100999:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236065280:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101008:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236065792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101017:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236066304:0@lo:400:kworker.0 00000100:00080000:1.0:1783947450.101062:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947450.101067:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947450.101069:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947450.101088:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236065536:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.101127:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236066048:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.101158:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236066560:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101175:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.101191:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783947450.101197:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236065408:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.101246:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236065920:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.101273:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236066432:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101290:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.101310:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065536 00000100:00100000:1.0:1783947450.101313:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065536 00000100:00100000:1.0:1783947450.101332:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065920 00000100:00100000:1.0:1783947450.101335:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065920 00000100:00100000:1.0:1783947450.101351:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066432 00000100:00100000:1.0:1783947450.101353:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066432 00000100:00100000:1.0:1783947450.101366:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783947450.101371:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236065536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101406:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236065536:12345-0@lo:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.101412:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783947450.101423:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1783947450.101429:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236065920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101453:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236065920:12345-0@lo:400:kworker.0 Request processed in 24us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.101483:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1783947450.101494:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1783947450.101500:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236066432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101526:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236066432:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.101532:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1783947450.101557:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066048 00000100:00100000:1.0:1783947450.101561:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066048 00000100:00100000:1.0:1783947450.101579:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066560 00000100:00100000:1.0:1783947450.101581:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066560 00000100:00100000:1.0:1783947450.101596:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947450.101601:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236066048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101630:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236066048:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.101635:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783947450.101644:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783947450.101649:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236066560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101668:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236066560:12345-0@lo:400:kworker.0 Request processed in 20us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.101673:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1783947450.101690:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947450.101692:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947450.101694:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783947450.101723:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e8700 x1870604236065920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.101733:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236065920:0@lo:400:kworker.0 00010000:00080000:1.0:1783947450.101741:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2300 x1870604236066432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.101748:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236066432:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.101756:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236065536:0@lo:400:kworker.0 00010000:00080000:1.0:1783947450.101764:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ead80 x1870604236066048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.101783:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236066048:0@lo:400:kworker.0 00010000:00080000:1.0:1783947450.101795:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0e00 x1870604236066560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.101802:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236066560:0@lo:400:kworker.0 00000100:00100000:1.0:1783947450.102097:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236066816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947450.102124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.102159:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066816 00000100:00100000:1.0:1783947450.102222:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066816 00000100:00100000:1.0:1783947450.102252:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783947450.102257:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236066816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947450.102280:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947450.102314:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236066816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.102321:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1783947450.102346:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac66d4a80 x1870604236066816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.102359:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236066816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947450.102565:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065664 00000100:00100000:2.0:1783947450.102570:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065664 00000100:00100000:2.0:1783947450.102608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236065408 00000100:00100000:2.0:1783947450.102611:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236065408 00000100:00100000:2.0:1783947450.102625:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783947450.102631:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236065664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947450.102673:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236065664:12345-0@lo:400:kworker.0 Request processed in 42us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947450.102679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783947450.102694:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783947450.102700:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236065408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947450.102743:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236065408:12345-0@lo:400:kworker.0 Request processed in 42us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947450.102748:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783947450.102781:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236065408:0@lo:400:kworker.0 00000100:00100000:2.0:1783947450.102802:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236065664:0@lo:400:kworker.0 00000100:00100000:3.0:1783947450.103668:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236066304:12345-0@lo:400:kworker.0 Request processed in 2980us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947450.103678:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00010000:0.0:1783947450.548618:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947450.613953:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236066944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947450.614023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947450.614096:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236066944 00000100:00100000:1.0:1783947450.614104:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236066944 00000100:00100000:1.0:1783947450.614147:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783947450.614155:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236066944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947450.614184:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947450.614222:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236066944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947450.614230:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1783947450.614268:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac66d4a80 x1870604236066944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947450.614285:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236066944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947451.177152:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947451.177492:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963264 00000100:00100000:0.0:1783947451.177505:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963264 00000100:00100000:0.0:1783947451.177567:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 312 00000100:00100000:0.0:1783947451.177578:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:6179:x1870604213963264:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947451.177597:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947451.177620:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e15 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.177649:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.177660:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.177670:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b200, rc 0) 00000100:00100000:0.0:1783947451.177745:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213963264:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 168us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.177761:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 312 00000100:00100000:2.0:1783947451.185867:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947451.185924:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963392 00000100:00100000:0.0:1783947451.185935:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963392 00000100:00100000:0.0:1783947451.186005:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 313 00000100:00100000:0.0:1783947451.186014:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213963392:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.186187:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213963392:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 174us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.186195:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 313 00000100:00100000:0.0:1783947451.188926:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947451.189111:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963520 00000100:00100000:2.0:1783947451.189124:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963520 00000100:00100000:2.0:1783947451.189183:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 314 00000100:00100000:2.0:1783947451.189203:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213963520:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947451.189361:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213963520:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 161us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947451.189369:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 314 00000100:00100000:0.0:1783947451.210332:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947451.212892:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963648 00000100:00100000:1.0:1783947451.212909:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963648 00000100:00100000:1.0:1783947451.213418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 315 00000100:00100000:1.0:1783947451.213431:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213963648:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947451.213450:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947451.213503:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e1c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.213539:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.213552:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.213562:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439400, rc 0) 00000100:00100000:1.0:1783947451.213633:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213963648:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 205us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947451.213641:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 315 00000100:00100000:3.0:1783947451.217450:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947451.217705:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963776 00000100:00100000:0.0:1783947451.217716:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963776 00000100:00100000:0.0:1783947451.217772:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 316 00000100:00100000:0.0:1783947451.217782:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213963776:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.217935:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213963776:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 154us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.217943:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 316 00000100:00100000:0.0:1783947451.223429:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947451.225447:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213963904 00000100:00100000:1.0:1783947451.225489:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213963904 00000100:00100000:1.0:1783947451.225632:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 317 00000100:00100000:1.0:1783947451.225643:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213963904:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947451.225873:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213963904:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 231us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947451.225882:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 317 10000000:01000000:0.0:1783947451.253380:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947451.253389:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc47c2000 from 7 10000000:01000000:0.0:1783947451.253394:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947451.253438:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.253449:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.253486:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947451.253513:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.253584:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947451.253643:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc71009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947451.253670:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067072 00000100:00100000:3.0:1783947451.253687:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067072 00000100:00100000:3.0:1783947451.253741:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783947451.253749:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236067072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947451.253763:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947451.253776:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500273 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.253797:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.253807:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.253815:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:3.0:1783947451.253851:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236067072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.253858:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783947451.254454:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947451.254486:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.254495:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947451.254562:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.254592:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947451.254614:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc71009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947451.254634:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067200 00000100:00100000:0.0:1783947451.254638:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067200 00000100:00100000:0.0:1783947451.254666:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1783947451.254673:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236067200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.254798:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236067200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.254805:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1783947451.254833:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.254859:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.254906:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947451.254920:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc71009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947451.254932:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067328 00000100:00100000:0.0:1783947451.254935:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067328 00000100:00100000:0.0:1783947451.254953:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783947451.254960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236067328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.255044:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236067328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.255050:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1783947451.255085:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947451.257871:0:13270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783947451.258041:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783947451.258069:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947451.258093:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.258106:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947451.258126:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947451.258129:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bff958800 from 7 10000000:01000000:3.0:1783947451.258131:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947451.258170:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.258178:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.258189:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947451.258216:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947451.258300:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947451.258341:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac758da80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947451.258363:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067456 00000100:00100000:3.0:1783947451.258369:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067456 00000100:00100000:3.0:1783947451.258411:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1783947451.258422:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236067456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947451.258437:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947451.258451:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500281 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.258497:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.258507:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947451.258526:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:3.0:1783947451.258569:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236067456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.258576:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1783947451.263212:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947451.263249:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947451.263264:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947451.263441:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947451.263586:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947451.263676:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7803300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947451.264221:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067584 00000100:00100000:0.0:1783947451.264229:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067584 00000100:00100000:0.0:1783947451.264289:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783947451.264300:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236067584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.264448:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236067584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.264472:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783947451.264522:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.264563:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.264615:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947451.264628:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc701f300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947451.265188:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067712 00000100:00100000:3.0:1783947451.265194:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067712 00000100:00100000:3.0:1783947451.265230:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783947451.265238:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236067712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947451.265355:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236067712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947451.265362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1783947451.266197:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947451.267594:0:13272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783947451.267812:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783947451.267840:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947451.267853:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.267865:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947451.268032:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947451.268035:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be784d800 from 7 10000000:01000000:1.0:1783947451.268038:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947451.268079:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.268087:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.268098:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947451.268123:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947451.270366:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947451.270437:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947451.270691:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067840 00000100:00100000:2.0:1783947451.270701:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067840 00000100:00100000:2.0:1783947451.270764:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1783947451.270773:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236067840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947451.270792:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947451.270811:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550028f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947451.270839:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947451.270853:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947451.270886:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f600, rc 0) 00000100:00100000:2.0:1783947451.270946:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236067840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947451.270954:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1783947451.271012:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947451.271031:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.271042:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947451.271127:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947451.271741:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947451.271774:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947451.272614:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236067968 00000100:00100000:0.0:1783947451.272625:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236067968 00000100:00100000:0.0:1783947451.272675:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783947451.272699:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236067968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.272858:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236067968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.272866:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1783947451.273048:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236067968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947451.273101:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947451.273226:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947451.273260:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947451.273325:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068096 00000100:00100000:2.0:1783947451.273330:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068096 00000100:00100000:2.0:1783947451.273364:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1783947451.273371:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236068096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947451.273490:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236068096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947451.273498:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783947451.273889:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947451.275962:0:13273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783947451.276047:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783947451.276082:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947451.276094:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.276106:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947451.276117:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947451.276120:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc9511800 from 7 10000000:01000000:1.0:1783947451.276130:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947451.276176:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.276197:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.276208:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947451.276233:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947451.276299:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947451.276337:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947451.278221:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068224 00000100:00100000:0.0:1783947451.278234:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068224 00000100:00100000:0.0:1783947451.278310:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783947451.278320:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236068224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947451.278338:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947451.278356:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550029d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.278384:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.278395:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947451.278403:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ac00, rc 0) 00000100:00100000:0.0:1783947451.278512:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236068224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.278520:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1783947451.278551:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947451.278580:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947451.278598:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947451.278724:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947451.278793:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947451.278836:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947451.278913:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068352 00000100:00100000:0.0:1783947451.278932:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068352 00000100:00100000:0.0:1783947451.278971:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783947451.278978:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236068352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.279135:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236068352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.279144:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1783947451.283058:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947451.283131:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947451.283216:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947451.283262:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068480 00000100:00100000:2.0:1783947451.283270:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3dcaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947451.283270:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068480 00000100:00100000:0.0:1783947451.283331:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783947451.283341:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236068480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947451.283485:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236068480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947451.283493:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1783947451.283584:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236068480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947451.284783:0:13274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783947451.284942:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783947451.284971:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947451.284983:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947451.284994:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947451.576099:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947452.150743:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236068608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947452.150861:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947452.151149:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068608 00000100:00100000:0.0:1783947452.151158:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068608 00000100:00100000:0.0:1783947452.151210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783947452.151220:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236068608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947452.151260:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947452.151336:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236068608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947452.151343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783947452.151418:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236068608:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947452.601148:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783947453.005816:0:13378:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783947453.620297:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947453.684005:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236068864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947453.684510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947453.684656:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947453.684665:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236068736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947453.684697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947453.684764:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068864 00000100:00100000:1.0:1783947453.684772:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068864 00000100:00100000:1.0:1783947453.684816:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068736 00000100:00100000:1.0:1783947453.684819:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068736 00000100:00100000:1.0:1783947453.684837:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947453.684862:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236068864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947453.684896:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947453.684940:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236068864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947453.684948:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947453.684966:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783947453.684973:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236068736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947453.684986:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947453.685009:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236068736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947453.685015:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1783947453.685031:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947453.691376:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb9500 x1870604236068736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947453.691404:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236068736:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783947453.693842:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac66d5880 x1870604236068864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947453.693880:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236068864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947453.926017:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947453.926096:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947453.926135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947453.926222:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964288 00000100:00100000:2.0:1783947453.926233:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964288 00000100:00100000:2.0:1783947453.926303:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964544 00000100:00100000:2.0:1783947453.926306:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964544 00000100:00100000:2.0:1783947453.926333:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:2.0:1783947453.926343:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213964288:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947453.926419:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213964288:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947453.926426:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:2.0:1783947453.926442:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:2.0:1783947453.926448:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213964544:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947453.926536:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213964544:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 87us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947453.926542:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00080000:0.0:1783947453.926998:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947453.928190:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964032 00000100:00100000:1.0:1783947453.928201:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964032 00000100:00100000:1.0:1783947453.928321:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 330 00000100:00100000:1.0:1783947453.928332:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213964032:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947453.928415:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213964032:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 85us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947453.928423:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 330 00000100:00100000:0.0:1783947453.933782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947453.933827:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947453.934189:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964160 00000100:00100000:3.0:1783947453.934212:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964160 00000100:00100000:3.0:1783947453.934286:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964416 00000100:00100000:3.0:1783947453.934290:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964416 00000100:00100000:3.0:1783947453.934320:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:3.0:1783947453.934330:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213964160:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947453.934438:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213964160:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 109us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947453.934446:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:3.0:1783947453.934500:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00100000:3.0:1783947453.934507:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213964416:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947453.934531:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213964416:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947453.934537:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00080000:0.0:1783947453.934924:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947454.195678:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947454.195703:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236068992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947454.195779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947454.195958:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236068992 00000100:00100000:2.0:1783947454.195966:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236068992 00000100:00100000:2.0:1783947454.196015:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783947454.196025:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236068992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947454.196061:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947454.196105:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236068992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947454.196112:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783947454.196544:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236068992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947454.648826:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947455.219895:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236069120:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.219973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220154:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236069632:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220217:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236070144:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220264:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236070656:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220285:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220318:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783947455.220325:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236069504:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220368:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236070016:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220406:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236070528:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220482:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236069248:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220526:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236069760:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220568:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236070272:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220618:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783947455.220625:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236069376:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220646:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220664:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236069888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220710:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236070400:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.220732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947455.220856:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236069632 00000100:00100000:2.0:1783947455.220865:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236069632 00000100:00100000:2.0:1783947455.220919:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236069376 00000100:00100000:2.0:1783947455.220922:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236069376 00000100:00100000:2.0:1783947455.220940:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783947455.220949:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236069632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.221090:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236069632:12345-0@lo:400:kworker.0 Request processed in 141us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.221098:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783947455.221117:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783947455.221123:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236069376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.221156:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236069376:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.221162:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783947455.221182:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070144 00000100:00100000:2.0:1783947455.221186:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070144 00000100:00100000:2.0:1783947455.221222:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070656 00000100:00100000:2.0:1783947455.221224:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070656 00000100:00100000:2.0:1783947455.221235:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070016 00000100:00100000:2.0:1783947455.221238:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070016 00000100:00100000:2.0:1783947455.221251:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070528 00000100:00100000:2.0:1783947455.221253:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070528 00000100:00100000:2.0:1783947455.221266:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783947455.221272:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236070144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.221303:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236070144:12345-0@lo:400:kworker.0 Request processed in 31us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.221320:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783947455.221334:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783947455.221340:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236070656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.221369:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236070656:12345-0@lo:400:kworker.0 Request processed in 29us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.221374:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783947455.221386:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783947455.221391:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236070016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.221417:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236070016:12345-0@lo:400:kworker.0 Request processed in 27us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.221423:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783947455.221435:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947455.221441:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236070528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.221887:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236070528:12345-0@lo:400:kworker.0 Request processed in 434us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.221895:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947455.221921:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236069504 00000100:00100000:2.0:1783947455.221925:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236069504 00000100:00100000:2.0:1783947455.221946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236069248 00000100:00100000:2.0:1783947455.221948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236069248 00000100:00100000:2.0:1783947455.221958:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236069760 00000100:00100000:2.0:1783947455.221961:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236069760 00000100:00100000:2.0:1783947455.221972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070272 00000100:00100000:2.0:1783947455.221975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070272 00000100:00100000:2.0:1783947455.221985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236069888 00000100:00100000:2.0:1783947455.221987:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236069888 00000100:00100000:2.0:1783947455.221997:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070400 00000100:00100000:2.0:1783947455.222007:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070400 00000100:00100000:2.0:1783947455.222026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783947455.222042:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236069504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947455.222160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783947455.222170:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236069248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947455.222213:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236069248:12345-0@lo:400:kworker.0 Request processed in 45us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947455.222229:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783947455.222247:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783947455.222257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236069760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222265:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236069504:12345-0@lo:400:kworker.0 Request processed in 232us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.222274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783947455.222309:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236069760:12345-0@lo:400:kworker.0 Request processed in 55us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947455.222321:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783947455.222336:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783947455.222341:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236070272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222372:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1783947455.222376:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236070272:12345-0@lo:400:kworker.0 Request processed in 32us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.222386:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236069888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947455.222387:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783947455.222410:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1783947455.222420:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236070400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222428:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236069888:12345-0@lo:400:kworker.0 Request processed in 45us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947455.222434:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1783947455.222487:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236070400:12345-0@lo:400:kworker.0 Request processed in 69us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947455.222494:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783947455.222563:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236069376:0@lo:400:kworker.0 00010000:00080000:2.0:1783947455.222579:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ee300 x1870604236069888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947455.222588:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236069888:0@lo:400:kworker.0 00010000:00080000:2.0:1783947455.222600:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ece00 x1870604236070400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947455.222621:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236070400:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222634:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236069248:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222645:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236069760:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222655:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236070272:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222701:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236069504:0@lo:400:kworker.0 00010000:00080000:2.0:1783947455.222723:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77efb80 x1870604236070016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947455.222733:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236070016:0@lo:400:kworker.0 00010000:00080000:2.0:1783947455.222750:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e81500 x1870604236070528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947455.222758:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236070528:0@lo:400:kworker.0 00000100:00100000:2.0:1783947455.222769:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236069632:0@lo:400:kworker.0 00010000:00080000:2.0:1783947455.222780:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77eea00 x1870604236070144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947455.222787:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236070144:0@lo:400:kworker.0 00010000:00080000:2.0:1783947455.222797:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e83800 x1870604236070656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947455.222804:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236070656:0@lo:400:kworker.0 00000100:00100000:1.0:1783947455.223250:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236069120 00000100:00100000:1.0:1783947455.223256:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236069120 00000100:00100000:1.0:1783947455.223429:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783947455.223439:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236069120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947455.223538:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236069120:12345-0@lo:400:kworker.0 Request processed in 101us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947455.223547:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1783947455.223686:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236069120:0@lo:400:kworker.0 00000100:00100000:0.0:1783947455.224179:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947455.224193:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236070784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947455.224235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947455.224272:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947455.224277:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947455.224281:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947455.224283:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947455.224307:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070784 00000100:00100000:0.0:1783947455.224312:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070784 00000100:00100000:0.0:1783947455.224347:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783947455.224356:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236070784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783947455.224383:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947455.224422:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236070784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947455.224428:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1783947455.224477:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8700 x1870604236070784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947455.224493:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236070784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783947455.667731:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947455.733832:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947455.733857:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236070912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947455.733932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947455.734059:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236070912 00000100:00100000:0.0:1783947455.734068:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236070912 00000100:00100000:0.0:1783947455.734122:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783947455.734131:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236070912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947455.734154:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947455.734207:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236070912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947455.734230:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1783947455.734314:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e83800 x1870604236070912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947455.734333:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236070912:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783947456.691810:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947457.268269:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236071040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947457.268365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947457.269273:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071040 00000100:00100000:0.0:1783947457.269287:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071040 00000100:00100000:0.0:1783947457.269363:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783947457.269376:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236071040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947457.269428:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947457.269595:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236071040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 221us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947457.269603:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783947457.273796:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236071040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947457.721213:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947458.739727:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947458.806001:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236071168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947458.806075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947458.806146:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071168 00000100:00100000:0.0:1783947458.806155:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071168 00000100:00100000:0.0:1783947458.806207:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783947458.806216:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236071168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947458.806246:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947458.806289:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236071168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947458.806297:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1783947458.806318:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947458.806349:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8700 x1870604236071168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947458.806368:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236071168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947458.806800:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236071296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947458.806833:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947458.806909:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071296 00000100:00100000:1.0:1783947458.806914:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071296 00000100:00100000:1.0:1783947458.806952:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783947458.806960:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236071296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947458.806972:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947458.807006:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236071296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947458.807012:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1783947458.807100:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947458.807130:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac66d7100 x1870604236071296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947458.807146:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236071296:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1783947458.922609:0:13528:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:57:36 (1783947456) === 00000100:00100000:3.0:1783947459.047938:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.047983:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.048015:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.048041:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.048067:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.048095:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964672 00000100:00100000:3.0:1783947459.048104:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964672 00000100:00100000:3.0:1783947459.048157:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 332 00000100:00100000:3.0:1783947459.048168:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213964672:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947459.048246:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213964672:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947459.048254:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 332 00000100:00100000:2.0:1783947459.050747:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964800 00000100:00100000:2.0:1783947459.050761:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964800 00000100:00100000:2.0:1783947459.050836:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213965056 00000100:00100000:2.0:1783947459.050839:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213965056 00000100:00100000:2.0:1783947459.050856:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213964928 00000100:00100000:2.0:1783947459.050859:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213964928 00000100:00100000:2.0:1783947459.050872:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213965184 00000100:00100000:2.0:1783947459.050875:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213965184 00000100:00100000:2.0:1783947459.050908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 201 00000100:00100000:2.0:1783947459.050918:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213964800:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947459.051004:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213964800:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 87us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.051012:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 201 00000100:00100000:2.0:1783947459.051031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 202 00000100:00100000:2.0:1783947459.051039:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213965056:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947459.051069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213965056:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 32us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.051076:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 202 00000100:00100000:2.0:1783947459.051092:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 203 00000100:00100000:2.0:1783947459.051101:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213964928:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947459.051107:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 204 00000100:00100000:3.0:1783947459.051119:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213965184:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947459.051134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213964928:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.051142:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 203 00000100:00100000:3.0:1783947459.051158:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213965184:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (3088us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947459.051166:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 204 00000100:00080000:0.0:1783947459.051338:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947459.051349:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947459.127369:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.127405:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.127432:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213965312 00000100:00100000:3.0:1783947459.127441:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213965312 00000100:00100000:3.0:1783947459.127519:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1783947459.127543:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213965312:12345-192.168.204.3@tcp:41:mkdir.0 00000004:00000024:3.0:1783947459.127592:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783947459.127735:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213965312:12345-192.168.204.3@tcp:41:mkdir.0 Request processed in 205us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947459.127743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1783947459.127774:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213965440 00000100:00100000:3.0:1783947459.127778:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213965440 00000100:00100000:3.0:1783947459.127803:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1783947459.127810:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:1eb923ac-790a-478f-897e-124614dbce09+6:10500:x1870604213965440:12345-192.168.204.3@tcp:700:mkdir.0 00000100:00100000:3.0:1783947459.127845:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:1eb923ac-790a-478f-897e-124614dbce09+6:10500:x1870604213965440:12345-192.168.204.3@tcp:700:mkdir.0 Request processed in 35us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947459.127852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:2.0:1783947459.142034:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947459.142572:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213965696 00000100:00100000:0.0:1783947459.142583:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213965696 00000100:00100000:0.0:1783947459.142647:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:0.0:1783947459.142658:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+6:10500:x1870604213965696:12345-192.168.204.3@tcp:36:mkdir.0 00010000:00010000:0.0:1783947459.142733:0:12193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947459.142809:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb5550014d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d90 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.142828:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e4400) 00010000:00010000:0.0:1783947459.142856:0:12193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947459.142942:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.142955:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.142965:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.144850:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.144870:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.144881:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145829:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145854:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145863:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947459.145882:0:12193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f7979e8 reply state 000000007da258e0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145894:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145902:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7c003e5d00) 00010000:00010000:0.0:1783947459.145905:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947459.145909:0:12193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783947459.145916:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783947459.145925:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145932:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145939:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145946:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947459.145951:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145960:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145982:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:0.0:1783947459.145984:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947459.145988:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.145994:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947459.146014:0:12193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f7979e8 reply state 000000007da258e0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.146022:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.146028:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e7c003e5a00) 00010000:00010000:0.0:1783947459.146031:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947459.146033:0:12193:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783947459.146196:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+7:10500:x1870604213965696:12345-192.168.204.3@tcp:36:mkdir.0 Request processed in 3537us (4169us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783947459.146206:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947459.169186:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947459.169277:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213965824 00000100:00100000:1.0:1783947459.169288:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213965824 00000100:00100000:1.0:1783947459.169348:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:1.0:1783947459.169358:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+7:10501:x1870604213965824:12345-192.168.204.3@tcp:101:chmod.0 00010000:00010000:1.0:1783947459.169380:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947459.169409:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555002c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e23 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.169519:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555002c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.169546:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555002c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.169560:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555002c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947459.169610:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783947459.169615:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947459.169647:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555002c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.169688:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555002c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e23 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.169706:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555002c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e23 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.169715:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd001bb00) 00010000:00010000:1.0:1783947459.169718:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947459.169721:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438400, rc 0) 00000100:00100000:1.0:1783947459.169796:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+8:10501:x1870604213965824:12345-192.168.204.3@tcp:101:chmod.0 Request processed in 439us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947459.169803:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1783947459.178254:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.178419:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213966080 00000100:00100000:2.0:1783947459.178431:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213966080 00000100:00100000:2.0:1783947459.178525:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1783947459.178553:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+8:10501:x1870604213966080:12345-192.168.204.3@tcp:36:chmod.0 00010000:00010000:0.0:1783947459.178703:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947459.178732:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555002c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e23 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.178754:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bd001bb00) 00010000:00010000:0.0:1783947459.178765:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947459.178794:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.178808:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.178830:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947459.179029:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe44f3a8 reply state 00000000a7e56ba7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.179042:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.179049:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:0.0:1783947459.179051:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783947459.179054:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783947459.179061:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783947459.179143:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+9:10501:x1870604213966080:12345-192.168.204.3@tcp:36:chmod.0 Request processed in 594us (899us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783947459.179151:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1783947459.204894:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947459.204969:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213966208 00000100:00100000:0.0:1783947459.204979:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213966208 00000100:00100000:0.0:1783947459.205054:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:0.0:1783947459.205065:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+9:10502:x1870604213966208:12345-192.168.204.3@tcp:101:chown.0 00010000:00010000:0.0:1783947459.205090:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947459.205112:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555002d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e2a expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.205189:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555002dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.205204:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555002dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.205232:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555002dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947459.205276:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947459.205280:0:12193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947459.205313:0:12193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555002dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.205337:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555002d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e2a expref: 11 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.205356:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555002dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e2a expref: 10 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.205365:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:0.0:1783947459.205368:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947459.205372:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:0.0:1783947459.205435:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+10:10502:x1870604213966208:12345-192.168.204.3@tcp:101:chown.0 Request processed in 373us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947459.205443:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:3.0:1783947459.211365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.211656:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213966336 00000100:00100000:2.0:1783947459.211666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213966336 00000100:00100000:2.0:1783947459.211727:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1783947459.211737:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+10:10502:x1870604213966336:12345-192.168.204.3@tcp:101:chown.0 00010000:00010000:2.0:1783947459.211770:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947459.211794:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555002e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e31 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.211858:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212002:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212016:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212029:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212043:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555002f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212140:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555002f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212147:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555002f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947459.212191:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947459.212200:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947459.212224:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555002f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212236:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212243:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212251:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212257:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947459.212261:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212269:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212281:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:2.0:1783947459.212284:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947459.212289:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212295:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb555002ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212308:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212315:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212332:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212338:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947459.212341:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212348:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212356:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e7c003e5a00) 00010000:00010000:2.0:1783947459.212358:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947459.212361:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212367:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555002f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212394:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555002e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e31 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212407:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555002f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e31 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.212414:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7c003e5d00) 00010000:00010000:2.0:1783947459.212416:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947459.212419:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f800, rc 0) 00000100:00100000:2.0:1783947459.212763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+11:10502:x1870604213966336:12345-192.168.204.3@tcp:101:chown.0 Request processed in 1026us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.212781:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:3.0:1783947459.220129:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.221000:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213966464 00000100:00100000:2.0:1783947459.221015:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213966464 00000100:00100000:2.0:1783947459.221085:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:2.0:1783947459.221097:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1eb923ac-790a-478f-897e-124614dbce09+11:10502:x1870604213966464:12345-192.168.204.3@tcp:900:chown.0 00000100:00100000:2.0:1783947459.222069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1eb923ac-790a-478f-897e-124614dbce09+11:10502:x1870604213966464:12345-192.168.204.3@tcp:900:chown.0 Request processed in 969us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.222080:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1783947459.235479:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.235567:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213966720 00000100:00100000:3.0:1783947459.235584:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213966720 00000100:00100000:3.0:1783947459.235648:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1783947459.235656:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+11:10502:x1870604213966720:12345-192.168.204.3@tcp:36:chown.0 00010000:00010000:3.0:1783947459.235780:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947459.236214:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555002f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e31 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.236235:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7c003e5d00) 00010000:00010000:3.0:1783947459.236240:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947459.236263:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.236289:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.236299:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947459.239149:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1783947459.239255:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239268:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239277:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239284:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9be00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947459.239289:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239297:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239314:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e7c003e5a00) 00010000:00010000:1.0:1783947459.239325:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947459.239331:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239339:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555002b2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239361:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239368:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239374:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239379:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947459.239382:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239388:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239396:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7c003e5d00) 00010000:00010000:1.0:1783947459.239398:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947459.239401:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239407:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555002b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239420:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239435:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239441:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239446:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947459.239449:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239475:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239485:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:1.0:1783947459.239487:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947459.239491:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.239496:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555002ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947459.239627:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9a1dcc0 reply state 0000000013909e1c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.239644:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.239651:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7c003e5d00) 00010000:00010000:3.0:1783947459.239654:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1783947459.239657:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783947459.239669:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1783947459.239763:0:8291:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1783947459.239961:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+7:10502:x1870604213966720:12345-192.168.204.3@tcp:36:chown.0 Request processed in 4300us (4508us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783947459.239970:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00010000:00010000:1.0:1783947459.241610:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.241625:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.241632:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.241638:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947459.242094:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.242103:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.242121:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7c003e5d00) 00010000:00010000:1.0:1783947459.242124:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947459.242128:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.242135:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555002ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947459.262336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947459.262883:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213966848 00000100:00100000:1.0:1783947459.262895:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213966848 00000100:00100000:1.0:1783947459.262966:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:1.0:1783947459.262977:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:10503:x1870604213966848:12345-192.168.204.3@tcp:101:touch.500 00010000:00010000:1.0:1783947459.263000:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947459.263021:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947459.265443:0:6510:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2371us 00010000:00010000:3.0:1783947459.281688:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281713:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281725:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281741:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281755:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281763:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281897:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550031b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281906:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550031b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281912:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550031b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947459.281946:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947459.281950:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947459.281983:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550031b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.281994:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282001:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282008:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282014:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947459.282018:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282032:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282045:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:3.0:1783947459.282049:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947459.282053:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282060:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550030d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282071:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282077:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282083:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282088:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947459.282091:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282096:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282102:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e7bffb78f00) 00010000:00010000:3.0:1783947459.282104:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947459.282107:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282121:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500314 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282170:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e38 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282186:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550031b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e38 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.282194:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:3.0:1783947459.282196:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783947459.282199:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50400, rc 0) 00000100:00100000:3.0:1783947459.282372:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+7:10503:x1870604213966848:12345-192.168.204.3@tcp:101:touch.500 Request processed in 19394us (20043us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947459.282380:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:0.0:1783947459.287862:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.288309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213967104 00000100:00100000:2.0:1783947459.288321:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213967104 00000100:00100000:2.0:1783947459.288389:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:2.0:1783947459.288400:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+7:10503:x1870604213967104:12345-192.168.204.3@tcp:101:touch.500 00010000:00010000:2.0:1783947459.288421:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947459.288443:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500322 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e3f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.288929:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.288944:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.288954:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.288969:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.288993:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.288999:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947459.290228:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1783947459.293656:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500337 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293679:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293690:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500337 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293727:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293734:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293741:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293747:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947459.293751:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293758:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293783:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:2.0:1783947459.293785:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947459.293790:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293796:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500329 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947459.293889:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb417186 reply state 000000007bf7a081 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293902:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293908:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9e7bfcba0500) 00010000:00010000:2.0:1783947459.293910:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947459.293914:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783947459.293954:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500322 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e3f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293970:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500337 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e3f expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.293977:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bfcba0200) 00010000:00010000:2.0:1783947459.293980:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947459.293982:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ec00, rc 0) 00000100:00100000:2.0:1783947459.294095:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+10:10503:x1870604213967104:12345-192.168.204.3@tcp:101:touch.500 Request processed in 5696us (6243us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783947459.294105:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:0.0:1783947459.302960:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.303048:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213967360 00000100:00100000:3.0:1783947459.303058:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213967360 00000100:00100000:3.0:1783947459.303116:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:3.0:1783947459.303127:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+10:10503:x1870604213967360:12345-192.168.204.3@tcp:36:touch.500 00010000:00010000:3.0:1783947459.303186:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947459.303214:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500337 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e3f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.303234:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bfcba0200) 00010000:00010000:3.0:1783947459.303245:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947459.303302:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.303326:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.303336:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947459.303493:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000007cf74f8 reply state 00000000e1f62979 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.303506:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.303512:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bffb78f00) 00010000:00010000:3.0:1783947459.303515:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947459.303518:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947459.303617:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+11:10503:x1870604213967360:12345-192.168.204.3@tcp:36:touch.500 Request processed in 491us (666us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783947459.303624:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1783947459.309894:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947459.309991:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213967488 00000100:00100000:0.0:1783947459.310002:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213967488 00000100:00100000:0.0:1783947459.310079:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:0.0:1783947459.310090:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+11:10503:x1870604213967488:12345-192.168.204.3@tcp:101:touch.500 00010000:00010000:0.0:1783947459.310115:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947459.310136:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550034c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.310198:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550034c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e46 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.310213:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550034c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e46 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.310233:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bffb78f00) 00010000:00010000:0.0:1783947459.310236:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947459.310239:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ba00, rc 0) 00000100:00100000:0.0:1783947459.310298:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+12:10503:x1870604213967488:12345-192.168.204.3@tcp:101:touch.500 Request processed in 210us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947459.310304:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:1.0:1783947459.314988:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.315095:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213967616 00000100:00100000:2.0:1783947459.315104:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213967616 00000100:00100000:2.0:1783947459.315147:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1783947459.315156:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1870604213967616:12345-192.168.204.3@tcp:8:touch.500 00010000:00080000:2.0:1783947459.315192:0:8426:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp t0 exp 0000000000000000 cur 344 last 0 00000020:00000080:2.0:1783947459.315221:0:8426:0:(genops.c:1406:class_connect()) connect: client 1eb923ac-790a-478f-897e-124614dbce09, cookie 0xe6fd1fdb55500353 00002000:00100000:2.0:1783947459.315231:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1eb923ac-790a-478f-897e-124614dbce09/ffff9e7ac73cc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783947459.315243:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783947459.315330:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783947459.315380:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9e7ac674f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947459.315498:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2405:x1870604213967616:12345-192.168.204.3@tcp:8:touch.500 Request processed in 341us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.315507:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:0.0:1783947459.316823:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236071424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947459.316886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947459.316918:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071424 00000100:00100000:2.0:1783947459.316926:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071424 00000100:00100000:2.0:1783947459.316975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783947459.316983:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236071424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947459.317016:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947459.318902:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236071424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947459.318907:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236071424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1818us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.318922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783947459.329364:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.329597:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213967744 00000100:00100000:2.0:1783947459.329607:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213967744 00000100:00100000:2.0:1783947459.329692:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1783947459.329703:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+6:0:x1870604213967744:12345-192.168.204.3@tcp:2:touch.500 00000100:00080000:0.0:1783947459.329738:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783947459.332387:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1783947459.332401:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000100:00100000:2.0:1783947459.332723:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:0:x1870604213967744:12345-192.168.204.3@tcp:2:touch.500 Request processed in 3015us (3361us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783947459.332749:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:3.0:1783947459.339744:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.339891:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213968000 00000100:00100000:2.0:1783947459.339901:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213968000 00000100:00100000:2.0:1783947459.339969:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:2.0:1783947459.339980:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+12:10503:x1870604213968000:12345-192.168.204.3@tcp:35:touch.500 00000100:00100000:2.0:1783947459.340270:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+13:10503:x1870604213968000:12345-192.168.204.3@tcp:35:touch.500 Request processed in 291us (536us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783947459.340277:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:1.0:1783947459.357612:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.357989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213968128 00000100:00100000:2.0:1783947459.358000:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213968128 00000100:00100000:2.0:1783947459.358256:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:2.0:1783947459.358265:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+13:10504:x1870604213968128:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:2.0:1783947459.358290:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947459.358311:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550035a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e4d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.358383:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500361 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.358403:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.358413:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947459.358512:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947459.358516:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947459.358576:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500361 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.358604:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550035a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e4d expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.358624:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500361 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e4d expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.358631:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:2.0:1783947459.358634:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947459.358637:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e600, rc 0) 00000100:00100000:2.0:1783947459.358784:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+14:10504:x1870604213968128:12345-192.168.204.3@tcp:101:rm.0 Request processed in 519us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.358858:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:1.0:1783947459.362671:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947459.363131:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213968384 00000100:00100000:0.0:1783947459.363143:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213968384 00000100:00100000:0.0:1783947459.363250:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1783947459.363261:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+14:10504:x1870604213968384:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:0.0:1783947459.363298:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947459.363318:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55500368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e54 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947459.363415:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783947459.363614:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55500368 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e54 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.363629:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:0.0:1783947459.363633:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947459.363637:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb55500368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e54 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947459.363651:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9be00, rc 0) 00000100:00100000:0.0:1783947459.363716:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+15:10504:x1870604213968384:12345-192.168.204.3@tcp:101:rm.0 Request processed in 458us (1054us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1783947459.363724:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:0.0:1783947459.368504:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.368605:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213968512 00000100:00100000:2.0:1783947459.368616:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213968512 00000100:00100000:2.0:1783947459.368676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1783947459.368687:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+15:10504:x1870604213968512:12345-192.168.204.3@tcp:37:rm.0 00000100:00100000:2.0:1783947459.379259:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+15:10504:x1870604213968512:12345-192.168.204.3@tcp:37:rm.0 Request processed in 10562us (10756us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.379276:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:1.0:1783947459.389928:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947459.390250:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213968768 00000100:00100000:0.0:1783947459.390261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213968768 00000100:00100000:0.0:1783947459.390326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1783947459.390336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+15:10504:x1870604213968768:12345-192.168.204.3@tcp:35:rm.0 00000100:00100000:0.0:1783947459.390617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+16:10504:x1870604213968768:12345-192.168.204.3@tcp:35:rm.0 Request processed in 281us (697us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783947459.390625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1783947459.396065:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.396163:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213969024 00000100:00100000:2.0:1783947459.396173:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213969024 00000100:00100000:2.0:1783947459.396236:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:2.0:1783947459.396245:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+16:10504:x1870604213969024:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:2.0:1783947459.396273:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947459.396319:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e5b expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.396427:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550037d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.396442:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550037d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.396494:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550037d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947459.396508:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783947459.396669:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e5b expref: 19 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.396686:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550037d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e5b expref: 18 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.396696:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:2.0:1783947459.396699:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783947459.396702:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f000, rc 0) 00000100:00100000:2.0:1783947459.397583:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:10504:x1870604213969024:12345-192.168.204.3@tcp:101:rm.0 Request processed in 1334us (1523us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783947459.397593:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:1.0:1783947459.405084:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.405208:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213969152 00000100:00100000:2.0:1783947459.405219:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213969152 00000100:00100000:2.0:1783947459.405284:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:2.0:1783947459.405306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:10504:x1870604213969152:12345-192.168.204.3@tcp:41:rm.0 00000004:00000024:2.0:1783947459.405387:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1783947459.405519:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:10504:x1870604213969152:12345-192.168.204.3@tcp:41:rm.0 Request processed in 216us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.405540:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:0.0:1783947459.417731:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.417865:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213969280 00000100:00100000:3.0:1783947459.417879:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213969280 00000100:00100000:3.0:1783947459.417953:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:3.0:1783947459.417964:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+18:10504:x1870604213969280:12345-192.168.204.3@tcp:101:rm.0 00010000:00010000:3.0:1783947459.417994:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947459.418038:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550038b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e62 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.418150:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.418170:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.418183:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.418821:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.418836:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.418846:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.418971:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555003a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.418981:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555003a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.418988:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555003a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947459.419153:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783947459.419159:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947459.419186:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555003a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420494:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555003a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420518:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420558:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420566:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420572:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947459.420578:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420586:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420606:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:2.0:1783947459.420609:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947459.420615:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420623:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500392 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420649:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420656:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420662:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420667:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947459.420678:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420685:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420694:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9e7bfcba0500) 00010000:00010000:2.0:1783947459.420697:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947459.420700:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420707:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420763:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550038b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e62 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420781:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555003a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e62 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.420790:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bffb78f00) 00010000:00010000:2.0:1783947459.420792:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947459.420795:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947459.420904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+19:10504:x1870604213969280:12345-192.168.204.3@tcp:101:rm.0 Request processed in 2940us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947459.420916:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:0.0:1783947459.423967:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947459.424075:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213969536 00000100:00100000:2.0:1783947459.424088:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213969536 00000100:00100000:2.0:1783947459.424164:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:2.0:1783947459.424177:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+19:10504:x1870604213969536:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:2.0:1783947459.424350:0:12193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783947459.424389:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555003a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e62 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424417:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550034c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e46 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424432:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bffb78f00) 00010000:00010000:2.0:1783947459.424444:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb55500361 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e4d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424452:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:2.0:1783947459.424497:0:12193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947459.424551:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424570:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424583:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424596:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424604:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424610:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424738:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424747:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.424752:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947459.425047:0:12193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1783947459.425060:0:12193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344652601790ns, next at 345652598961ns, rc = 0 00010000:00010000:2.0:1783947459.425120:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.425130:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.425138:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.425146:0:12193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.425153:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.425159:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.425188:0:12193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947459.425268:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947459.425299:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.425309:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947459.425313:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.425323:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.425341:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bffb78f00) 00010000:00010000:1.0:1783947459.425344:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783947459.425349:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.425356:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb555003bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947459.425375:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947459.425377:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947459.425378:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947459.426214:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426242:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426250:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426256:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947459.426261:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426269:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426301:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bffb78f00) 00010000:00010000:2.0:1783947459.426304:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783947459.426309:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426315:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555003b5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426337:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426343:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426349:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426354:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947459.426362:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426368:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426377:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:2.0:1783947459.426379:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947459.426382:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426388:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555003a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947459.426397:0:12193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5f4e052 reply state 000000005c33067e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426411:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947459.426417:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9e7bfcba0500) 00010000:00010000:2.0:1783947459.426420:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947459.426423:0:12193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947459.426568:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:10504:x1870604213969536:12345-192.168.204.3@tcp:36:rm.0 Request processed in 2387us (2610us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783947459.426579:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:1.0:1783947459.430026:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947459.430180:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213969792 00000100:00100000:0.0:1783947459.430190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213969792 00000100:00100000:0.0:1783947459.430242:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1783947459.430253:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+18:10504:x1870604213969792:12345-192.168.204.3@tcp:35:rm.0 00000100:00100000:0.0:1783947459.431068:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+19:10504:x1870604213969792:12345-192.168.204.3@tcp:35:rm.0 Request processed in 288us (520us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783947459.431081:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1783947459.434016:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947459.435958:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970048 00000100:00100000:3.0:1783947459.435977:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970048 00000100:00100000:3.0:1783947459.436060:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947459.436071:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:10504:x1870604213970048:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:3.0:1783947459.436153:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783947459.436188:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550037d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e5b expref: 19 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436214:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50400/0xe6fd1fdb5550031b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e38 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436228:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78900) 00010000:00010000:3.0:1783947459.436245:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555002dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e2a expref: 17 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436255:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:3.0:1783947459.436262:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947459.436314:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436347:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436359:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436373:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436379:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436386:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436502:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436509:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436516:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947459.436799:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783947459.436821:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436829:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436837:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436849:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947459.436854:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436862:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436871:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9e7bffb78100) 00010000:00010000:3.0:1783947459.436874:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783947459.436878:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436883:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51000/0xe6fd1fdb555003d1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436905:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436911:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436917:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436922:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947459.436925:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436930:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436948:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb78c00) 00010000:00010000:3.0:1783947459.436950:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947459.436953:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436959:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555003c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947459.436969:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004685d13d reply state 00000000cab84174 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436981:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947459.436988:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e7bffb78400) 00010000:00010000:3.0:1783947459.436990:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947459.436993:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947459.437094:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:10504:x1870604213970048:12345-192.168.204.3@tcp:36:rm.0 Request processed in 1023us (3084us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783947459.437103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00010000:00010000:3.0:1783947459.764360:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947460.341727:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947460.341760:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236071552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947460.341837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947460.341901:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071552 00000100:00100000:1.0:1783947460.341910:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071552 00000100:00100000:1.0:1783947460.341964:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783947460.341974:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236071552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947460.342006:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947460.342050:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236071552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947460.342063:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1783947460.342086:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947460.342118:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b6d80 x1870604236071552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947460.342138:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236071552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947460.346131:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236071936:0@lo:400:kworker.0 00000100:00100000:0.0:1783947460.346715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.346772:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236072448:0@lo:400:kworker.0 00000100:00100000:0.0:1783947460.346807:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.346830:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236072960:0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.347036:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236072064:0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.347148:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236071808:0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.347181:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236071680:0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.347211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947460.347245:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236072192:0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.347267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.347285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947460.347286:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236072704:0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.347312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.347331:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071936 00000100:00100000:0.0:1783947460.347339:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071936 00000100:00100000:1.0:1783947460.347340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072192 00000100:00100000:1.0:1783947460.347342:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072192 00000100:00100000:3.0:1783947460.347399:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071680 00000100:00100000:3.0:1783947460.347402:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071680 00000100:00100000:3.0:1783947460.347435:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783947460.347444:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236071680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.347600:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783947460.347608:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236072192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.347649:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236072192:12345-0@lo:400:kworker.0 Request processed in 42us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947460.347656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783947460.347725:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236071680:12345-0@lo:400:kworker.0 Request processed in 282us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.347741:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783947460.347775:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072448 00000100:00100000:3.0:1783947460.347779:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072448 00000100:00100000:3.0:1783947460.347812:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072960 00000100:00100000:3.0:1783947460.347814:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072960 00000100:00100000:3.0:1783947460.347833:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783947460.347838:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236072448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.347875:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236072448:12345-0@lo:400:kworker.0 Request processed in 36us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.347880:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783947460.347892:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783947460.347898:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236072960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.347923:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236072960:12345-0@lo:400:kworker.0 Request processed in 26us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.347929:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783947460.347957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.347960:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783947460.347968:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236071936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.347980:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236072576:0@lo:400:kworker.0 00000100:00100000:0.0:1783947460.347999:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236071936:12345-0@lo:400:kworker.0 Request processed in 33us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.348002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.348005:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783947460.348018:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236073088:0@lo:400:kworker.0 00000100:00100000:0.0:1783947460.348026:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072064 00000100:00100000:0.0:1783947460.348029:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072064 00000100:00100000:3.0:1783947460.348037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.348050:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783947460.348055:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236072064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.348065:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072704 00000100:00100000:3.0:1783947460.348068:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072704 00000100:00100000:3.0:1783947460.348094:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072576 00000100:00100000:0.0:1783947460.348095:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236072064:12345-0@lo:400:kworker.0 Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.348096:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072576 00000100:00100000:0.0:1783947460.348101:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783947460.348112:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073088 00000100:00100000:3.0:1783947460.348114:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073088 00000100:00100000:3.0:1783947460.348128:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783947460.348141:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236072704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.348184:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236072704:12345-0@lo:400:kworker.0 Request processed in 44us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.348190:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783947460.348202:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783947460.348207:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236072576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.348233:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236072576:12345-0@lo:400:kworker.0 Request processed in 26us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.348238:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783947460.348248:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947460.348254:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236073088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.348278:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236073088:12345-0@lo:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.348283:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947460.348321:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236072064:0@lo:400:kworker.0 00010000:00080000:3.0:1783947460.348334:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ceb480 x1870604236072576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947460.348344:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236072576:0@lo:400:kworker.0 00010000:00080000:3.0:1783947460.348351:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6612d80 x1870604236073088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947460.348359:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236073088:0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.348390:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236071936:0@lo:400:kworker.0 00010000:00080000:3.0:1783947460.348400:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ce9c00 x1870604236072448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947460.348413:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236072448:0@lo:400:kworker.0 00010000:00080000:3.0:1783947460.348426:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac6613480 x1870604236072960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947460.348433:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236072960:0@lo:400:kworker.0 00000100:00100000:0.0:1783947460.348546:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.348575:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236072320:0@lo:400:kworker.0 00000100:00100000:0.0:1783947460.348599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947460.348613:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236072832:0@lo:400:kworker.0 00000100:00100000:0.0:1783947460.348632:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947460.349763:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236071808 00000100:00100000:3.0:1783947460.349773:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236071808 00000100:00100000:3.0:1783947460.349810:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072320 00000100:00100000:3.0:1783947460.349813:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072320 00000100:00100000:3.0:1783947460.349829:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236072832 00000100:00100000:3.0:1783947460.349832:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236072832 00000100:00100000:3.0:1783947460.349847:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783947460.349854:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236071808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.349912:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236071808:12345-0@lo:400:kworker.0 Request processed in 58us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.349919:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783947460.349931:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783947460.349937:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236072320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.349961:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236072320:12345-0@lo:400:kworker.0 Request processed in 25us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.349966:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783947460.349975:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783947460.349980:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236072832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.349999:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236072832:12345-0@lo:400:kworker.0 Request processed in 19us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947460.350012:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783947460.350053:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236071808:0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.350063:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236072320:0@lo:400:kworker.0 00000100:00100000:3.0:1783947460.350071:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236072832:0@lo:400:kworker.0 00000100:00080000:1.0:1783947460.350802:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947460.350808:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947460.350810:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947460.350813:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947460.350837:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236071680:0@lo:400:kworker.0 00000100:00100000:1.0:1783947460.350928:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236072192:0@lo:400:kworker.0 00010000:00080000:1.0:1783947460.350941:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ce8700 x1870604236072704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947460.351112:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236072704:0@lo:400:kworker.0 00010000:00010000:1.0:1783947460.789043:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947460.856512:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236073216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947460.856592:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947460.856671:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073216 00000100:00100000:1.0:1783947460.856679:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073216 00000100:00100000:1.0:1783947460.856729:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783947460.856739:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236073216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947460.856763:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947460.856806:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236073216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947460.856813:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1783947460.859368:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e82d80 x1870604236073216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947460.859401:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236073216:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783947461.817365:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947462.391964:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947462.391992:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236073344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947462.392556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947462.392804:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073344 00000100:00100000:2.0:1783947462.392812:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073344 00000100:00100000:2.0:1783947462.392883:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783947462.392891:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236073344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947462.392927:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947462.393645:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236073344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 753us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947462.393655:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783947462.397622:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236073344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783947462.835678:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783947463.353204:0:13676:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1783947463.862634:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783947463.923619:0:8535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349151159697ns, next at 350151155609ns, rc = 0 00000100:00100000:3.0:1783947463.923663:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236073472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947463.923768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947463.923842:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073472 00000100:00100000:3.0:1783947463.923848:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073472 00000100:00100000:3.0:1783947463.923902:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783947463.923911:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236073472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947463.923941:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947463.923985:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236073472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947463.923993:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1783947463.924014:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783947463.924045:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ce8700 x1870604236073472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947463.924065:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236073472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947463.927766:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947463.927824:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236073600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947463.927898:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947463.928106:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073600 00000100:00100000:1.0:1783947463.928114:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073600 00000100:00100000:1.0:1783947463.928177:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783947463.928192:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236073600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947463.928216:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947463.928268:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236073600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947463.928275:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1783947463.928329:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7502d80 x1870604236073600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947463.928349:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236073600:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783947463.928693:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947464.173929:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947464.174031:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947464.174207:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970176 00000100:00100000:3.0:1783947464.174218:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970176 00000100:00100000:3.0:1783947464.174278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 334 00000100:00100000:3.0:1783947464.174288:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213970176:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947464.174372:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213970176:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 85us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947464.174379:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 334 00000100:00100000:3.0:1783947464.174412:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970304 00000100:00100000:3.0:1783947464.174416:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970304 00000100:00100000:3.0:1783947464.175207:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00100000:3.0:1783947464.175217:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:2407:x1870604213970304:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947464.175270:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:2407:x1870604213970304:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 55us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947464.175277:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00080000:1.0:1783947464.176113:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947464.181881:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947464.181935:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947464.182008:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970560 00000100:00100000:3.0:1783947464.182019:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970560 00000100:00100000:3.0:1783947464.182083:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:3.0:1783947464.182095:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213970560:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947464.182173:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213970560:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947464.182180:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00080000:3.0:1783947464.182201:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947464.182982:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947464.189077:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947464.190054:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970816 00000100:00100000:2.0:1783947464.190068:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970816 00000100:00100000:2.0:1783947464.190163:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:2.0:1783947464.190177:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213970816:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947464.190272:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213970816:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 99us (8335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947464.190280:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:3.0:1783947464.190314:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970432 00000100:00100000:3.0:1783947464.190321:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970432 00000100:00100000:3.0:1783947464.190918:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970688 00000100:00100000:3.0:1783947464.190923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970688 00000100:00100000:3.0:1783947464.190951:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00100000:3.0:1783947464.190959:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213970432:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947464.191004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213970432:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 46us (8024us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947464.191026:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00100000:3.0:1783947464.191041:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 214 00000100:00100000:3.0:1783947464.191047:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213970688:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947464.191079:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213970688:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 32us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947464.191085:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 214 00000100:00080000:3.0:1783947464.191225:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947464.191230:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947464.438543:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947464.438575:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236073728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947464.438645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947464.438710:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073728 00000100:00100000:1.0:1783947464.438718:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073728 00000100:00100000:1.0:1783947464.438764:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783947464.438774:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236073728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947464.438813:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783947464.438858:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236073728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947464.438865:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783947464.438912:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236073728:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1783947464.515052:0:13724:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe027b7d50 20000000:00000080:1.0:1783947464.515072:0:13724:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7ac7713800 uarg=0000000000000000 20000000:01000000:1.0:1783947464.515116:0:13724:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1783947464.515122:0:13724:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1783947464.515127:0:13724:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1783947464.516063:0:13725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1783947464.516384:0:13724:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1783947464.532057:0:13724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1783947464.536096:0:13724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1783947464.536163:0:13724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1783947464.536189:0:13724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783947464.536212:0:13724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536229:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536236:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536244:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536250:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536255:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536261:0:13724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536283:0:13724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536319:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536333:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 23 pid: 6504 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.536347:0:13724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236073856:0@lo:104: 00000100:00100000:1.0:1783947464.536435:0:13724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947464.536734:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.536743:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 23 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.536751:0:13724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236073984:0@lo:104: 00010000:00010000:1.0:1783947464.536777:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.537083:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 23 pid: 6503 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.537094:0:13724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074112:0@lo:104: 00010000:00010000:1.0:1783947464.537134:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.537143:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 23 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.537169:0:13724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074240:0@lo:104: 00010000:00010000:1.0:1783947464.537199:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.537208:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 12 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.537217:0:13724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074368:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947464.537284:0:13724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.537292:0:13724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 12 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.537300:0:13724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074496:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947464.537321:0:13724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac76833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947464.537539:0:9527:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783947464.537562:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947464.537586:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947464.537602:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947464.537610:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073856 00000100:00100000:2.0:1783947464.537617:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073856 00000100:00100000:2.0:1783947464.537664:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236073984 00000100:00100000:2.0:1783947464.537667:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236073984 00000100:00100000:2.0:1783947464.537678:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236074112 00000100:00100000:2.0:1783947464.537681:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236074112 00000100:00100000:2.0:1783947464.537689:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236074240 00000100:00100000:2.0:1783947464.537691:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236074240 00000100:00100000:2.0:1783947464.537713:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947464.537722:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7149c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:13724:x1870604236073856:12345-0@lo:104: 00010000:00010000:2.0:1783947464.537736:0:9527:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.537787:0:9527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947464.537799:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7149c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+6:13724:x1870604236073856:12345-0@lo:104: Request processed in 79us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947464.538306:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947464.539770:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783947464.539787:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:13724:x1870604236073984:12345-0@lo:104: 00010000:00010000:1.0:1783947464.539803:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.540039:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947464.540046:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+5:13724:x1870604236073984:12345-0@lo:104: Request processed in 265us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947464.540054:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783947464.540080:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947464.540098:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:13724:x1870604236074112:12345-0@lo:104: 00010000:00010000:1.0:1783947464.540107:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.540140:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783947464.540145:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+4:13724:x1870604236074112:12345-0@lo:104: Request processed in 49us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947464.540214:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783947464.540227:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783947464.540232:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:13724:x1870604236074240:12345-0@lo:104: 00010000:00010000:1.0:1783947464.540240:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.540270:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783947464.540274:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+3:13724:x1870604236074240:12345-0@lo:104: Request processed in 42us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947464.540279:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1783947464.540294:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783947464.540299:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.540306:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438c00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947464.540310:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.540318:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947464.540326:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947464.540336:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947464.540372:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.540378:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947464.540396:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.540996:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438c00/0xe6fd1fdb5550029d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555002a4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541012:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783947464.541016:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541022:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947464.541025:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541032:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947464.541038:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947464.541043:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947464.541064:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541070:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947464.541086:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541092:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6438600/0xe6fd1fdb5550028f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500296 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541101:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947464.541104:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541109:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947464.541112:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541119:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947464.541124:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947464.541130:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947464.541143:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541224:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947464.541248:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541255:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96400/0xe6fd1fdb55500281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55500288 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541267:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947464.541277:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541283:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947464.541285:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541292:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947464.541299:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947464.541304:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783947464.541319:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541325:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947464.541331:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541337:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b800/0xe6fd1fdb55500273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550027a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.541351:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947464.541352:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947464.541354:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947464.541364:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947464.541380:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236074880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947464.543850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947464.544770:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947464.544796:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236075008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947464.544837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947464.544970:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236074880 00000100:00100000:1.0:1783947464.544977:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236074880 00010000:00010000:1.0:1783947464.545013:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 24 pid: 6503 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.545045:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075008 00000100:00100000:1.0:1783947464.545048:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075008 00010000:00010000:1.0:1783947464.545060:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 25 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.545087:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783947464.545095:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+25:3639:x1870604236074880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947464.545108:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947464.545113:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 25 pid: 6503 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.545124:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 25 pid: 6503 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.545144:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1783947464.545999:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1783947464.546027:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:1.0:1783947464.546028:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+25:3639:x1870604236074880:12345-0@lo:103:ldlm_bl.0 Request processed in 932us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947464.546037:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1783947464.546038:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1783947464.546057:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783947464.546063:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236075008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947464.546074:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947464.546080:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 24 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546100:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 24 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546114:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947464.546138:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236075008:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947464.546145:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1783947464.546185:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546195:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546201:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546207:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947464.546211:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546219:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546234:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9e7bfcba0500) 00010000:00010000:1.0:1783947464.546237:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947464.546241:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947464.546246:0:13724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236073856:0@lo:104: 00010000:00010000:1.0:1783947464.546249:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500330 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947464.546275:0:13724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236073984:0@lo:104: 00010000:00010000:1.0:1783947464.546280:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947464.546288:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97c00/0xe6fd1fdb55500288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55500281 expref: 23 pid: 6503 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546289:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546308:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546312:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00000100:00100000:0.0:1783947464.546314:0:13724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074112:0@lo:104: 00010000:00010000:1.0:1783947464.546316:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546324:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947464.546330:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb5550027a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55500273 expref: 22 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546334:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9e7bffb78f00) 00010000:00010000:1.0:1783947464.546341:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947464.546343:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546351:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500345 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947464.546367:0:13724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074240:0@lo:104: 00010000:00010000:1.0:1783947464.546378:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546385:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546390:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546413:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947464.546416:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546422:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546439:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9e7bfcba0500) 00010000:00010000:1.0:1783947464.546442:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947464.546444:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546450:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb555003ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546518:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546525:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546531:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546536:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947464.546538:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546543:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546562:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9e7bffb78400) 00010000:00010000:1.0:1783947464.546565:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947464.546568:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.546574:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555003ca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947464.546619:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236075008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947464.546630:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236074880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947464.546803:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947464.550704:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947464.550798:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236074624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947464.550994:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947464.551045:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236075136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783947464.551078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947464.551105:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947464.551112:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236074752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947464.551134:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947464.551681:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947464.551996:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947464.552054:0:13724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074368:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947464.552065:0:13724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13724:1870604236074496:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947464.552107:0:13724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947464.552200:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236074624 00000100:00100000:2.0:1783947464.552208:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236074624 00010000:00010000:2.0:1783947464.552243:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 22 pid: 6504 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947464.552280:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236074752 00000100:00100000:2.0:1783947464.552283:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236074752 00010000:00010000:2.0:1783947464.552296:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 23 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947464.552306:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971072 00000100:00100000:2.0:1783947464.552308:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971072 00010000:00010000:2.0:1783947464.552319:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 13 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947464.552329:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213970944 00000100:00100000:2.0:1783947464.552331:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213970944 00010000:00010000:2.0:1783947464.552352:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 14 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947464.552366:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947464.552375:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3637:x1870604236074624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947464.552389:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947464.552394:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 23 pid: 6504 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552406:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 23 pid: 6504 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552441:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb555002a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550029d expref: 23 pid: 6504 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552483:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947464.552527:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3637:x1870604236074624:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947464.552534:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947464.552550:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947464.552566:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3637:x1870604236074752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947464.552575:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947464.552579:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 21 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552588:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 21 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552598:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f600/0xe6fd1fdb55500296 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550028f expref: 21 pid: 6505 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552606:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947464.552627:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3637:x1870604236074752:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947464.552633:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947464.552645:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:2.0:1783947464.552651:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+14:2406:x1870604213971072:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947464.552659:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947464.552664:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 14 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552678:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 14 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552689:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55500265 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e15 expref: 14 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552698:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947464.552741:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213971072:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 89us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947464.552748:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:2.0:1783947464.552761:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:2.0:1783947464.552767:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:2407:x1870604213970944:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947464.552773:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947464.552777:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 12 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552784:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 12 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552793:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439400/0xe6fd1fdb5550026c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e1c expref: 12 pid: 6505 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552803:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552822:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552846:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552853:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552860:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552867:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552874:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947464.552878:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552885:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552898:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947464.552907:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947464.552940:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:2407:x1870604213970944:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 173us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947464.552946:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:2.0:1783947464.552979:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236074752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947464.552988:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236074624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947464.555279:0:13724:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947464.555299:0:13724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947464.555306:0:13724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438000/0xe6fd1fdb555003d8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947464.555631:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075136 00000100:00100000:3.0:1783947464.555642:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075136 00000100:00100000:3.0:1783947464.556634:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947464.556649:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bef962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236075136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783947464.556683:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1783947464.556718:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a54e0c2, atime: 0x6a54e0c2, ctime: 0x6a54e0c2, blocks: 0x0 00010000:00010000:3.0:1783947464.556726:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947464.556741:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1783947464.556745:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947464.556750:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947464.556767:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947464.556788:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947464.556796:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947464.556813:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947464.561923:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947464.561937:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.561951:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947464.561956:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.561970:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.561995:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.562003:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555003df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947464.562047:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947464.562049:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947464.562051:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947464.562095:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bef962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604236075136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5445us (11011us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783947464.562106:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1783947464.563660:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7bf7ce8700/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783947464.563687:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236075136:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783947464.884497:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947465.401302:0:13773:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4536daa0 20000000:00000080:2.0:1783947465.401323:0:13773:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7ac76f2000 uarg=0000000000000000 20000000:01000000:2.0:1783947465.401372:0:13773:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1783947465.401379:0:13773:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1783947465.401384:0:13773:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1783947465.402746:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1783947465.403110:0:13773:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1783947465.403277:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1783947465.403315:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1783947465.403590:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1783947465.403682:0:13773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783947465.403706:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403722:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403732:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403738:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403745:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403751:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403757:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947465.403760:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403785:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403798:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403806:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947465.403813:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439800/0xe6fd1fdb555003e6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947465.463999:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947465.464024:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236075264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947465.464100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947465.464224:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075264 00000100:00100000:1.0:1783947465.464232:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075264 00000100:00100000:1.0:1783947465.464297:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783947465.464307:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236075264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947465.464337:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947465.464387:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236075264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.464394:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1783947465.464446:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c91500 x1870604236075264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947465.464486:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236075264:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783947465.464564:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947465.471071:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236075392:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.471145:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947465.471243:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075392 00000100:00100000:2.0:1783947465.471251:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075392 00000100:00100000:2.0:1783947465.471304:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1783947465.471313:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3639:x1870604236075392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.472560:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3639:x1870604236075392:12345-0@lo:400:kworker.0 Request processed in 1231us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.472573:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1783947465.473049:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236075648:0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947465.473116:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236076160:0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947465.473154:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236076672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473174:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947465.473195:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783947465.473200:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236075776:0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473220:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947465.473236:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236076288:0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947465.473287:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236076800:0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947465.473331:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075648 00000100:00100000:2.0:1783947465.473337:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075648 00000100:00100000:2.0:1783947465.473374:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947465.473381:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236075648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473442:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236075648:12345-0@lo:400:kworker.0 Request processed in 61us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.473448:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947465.473483:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076160 00000100:00100000:2.0:1783947465.473487:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076160 00000100:00100000:2.0:1783947465.473519:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076672 00000100:00100000:2.0:1783947465.473522:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076672 00000100:00100000:2.0:1783947465.473667:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075776 00000100:00100000:2.0:1783947465.473671:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075776 00000100:00100000:2.0:1783947465.473689:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783947465.473695:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236076160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473831:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236076160:12345-0@lo:400:kworker.0 Request processed in 136us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.473837:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783947465.473849:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783947465.473854:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236076672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.473877:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236076672:12345-0@lo:400:kworker.0 Request processed in 23us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.473883:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783947465.473995:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783947465.474007:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236075776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.474033:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236075776:12345-0@lo:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.474038:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783947465.474073:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236075776:0@lo:400:kworker.0 00000100:00100000:2.0:1783947465.474082:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236075648:0@lo:400:kworker.0 00010000:00080000:2.0:1783947465.474092:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7ce9f80 x1870604236076160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947465.474102:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236076160:0@lo:400:kworker.0 00010000:00080000:2.0:1783947465.474110:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b4a80 x1870604236076672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947465.474118:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236076672:0@lo:400:kworker.0 00000100:00100000:3.0:1783947465.474249:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076288 00000100:00100000:3.0:1783947465.474253:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076288 00000100:00100000:3.0:1783947465.474285:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076800 00000100:00100000:3.0:1783947465.474287:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076800 00000100:00100000:3.0:1783947465.474309:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783947465.474315:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236076288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947465.474349:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236076288:12345-0@lo:400:kworker.0 Request processed in 35us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947465.474355:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783947465.474365:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783947465.474370:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236076800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947465.474390:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236076800:12345-0@lo:400:kworker.0 Request processed in 20us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947465.474404:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1783947465.474434:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947465.474438:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947465.474441:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947465.474476:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236076288:0@lo:400:kworker.0 00010000:00080000:3.0:1783947465.474486:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76b6a00 x1870604236076800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947465.474494:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236076800:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.474881:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236075392:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.474914:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236075904:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.474942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947465.474966:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236076416:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.474983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947465.475002:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783947465.475008:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236075520:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475025:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947465.475041:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236076032:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947465.475067:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236076544:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475081:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947465.475109:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076416 00000100:00100000:1.0:1783947465.475112:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076416 00000100:00100000:1.0:1783947465.475140:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947465.475145:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236076416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475176:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236076416:12345-0@lo:400:kworker.0 Request processed in 30us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.475181:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947465.475196:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075904 00000100:00100000:1.0:1783947465.475199:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075904 00000100:00100000:1.0:1783947465.475216:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783947465.475221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236075904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475245:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236075904:12345-0@lo:400:kworker.0 Request processed in 23us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.475250:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783947465.475268:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236075520 00000100:00100000:1.0:1783947465.475271:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236075520 00000100:00100000:1.0:1783947465.475286:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076032 00000100:00100000:1.0:1783947465.475288:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076032 00000100:00100000:1.0:1783947465.475300:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076544 00000100:00100000:1.0:1783947465.475302:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076544 00000100:00100000:1.0:1783947465.475314:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783947465.475319:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236075520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475342:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236075520:12345-0@lo:400:kworker.0 Request processed in 23us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.475347:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783947465.475356:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783947465.475360:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236076032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475378:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236076032:12345-0@lo:400:kworker.0 Request processed in 17us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.475383:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783947465.475391:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783947465.475395:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236076544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475428:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236076544:12345-0@lo:400:kworker.0 Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.475434:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783947465.475512:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236075520:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475520:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236076032:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475527:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236076544:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475544:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236075904:0@lo:400:kworker.0 00000100:00100000:1.0:1783947465.475568:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236076416:0@lo:400:kworker.0 00000100:00080000:2.0:1783947465.476656:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947465.476662:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947465.640646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947465.642127:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971200 00000100:00100000:0.0:1783947465.642141:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971200 00000100:00100000:0.0:1783947465.642209:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 336 00000100:00100000:0.0:1783947465.642220:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:6179:x1870604213971200:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947465.642237:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947465.642260:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb555003ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e69 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947465.642288:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb555003ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e69 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947465.642300:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb555003ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e69 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947465.642309:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a800, rc 0) 00000100:00100000:0.0:1783947465.642370:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213971200:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 152us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947465.642378:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 336 00000100:00100000:2.0:1783947465.645545:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947465.645609:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971328 00000100:00100000:3.0:1783947465.645617:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971328 00000100:00100000:3.0:1783947465.645674:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 337 00000100:00100000:3.0:1783947465.645683:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213971328:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947465.645840:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213971328:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 156us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947465.645848:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 337 00000100:00100000:2.0:1783947465.654560:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947465.654735:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971456 00000100:00100000:2.0:1783947465.654742:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971456 00000100:00100000:2.0:1783947465.654788:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 338 00000100:00100000:2.0:1783947465.654798:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213971456:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947465.654936:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213971456:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 138us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.654944:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 338 00000100:00100000:2.0:1783947465.660178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947465.660324:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971584 00000100:00100000:0.0:1783947465.660336:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971584 00000100:00100000:0.0:1783947465.660393:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 339 00000100:00100000:0.0:1783947465.660413:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:10789:x1870604213971584:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947465.660640:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:10789:x1870604213971584:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 239us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947465.660649:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 339 00000100:00100000:0.0:1783947465.666350:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947465.666439:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971712 00000100:00100000:2.0:1783947465.666449:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971712 00000100:00100000:2.0:1783947465.666881:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 340 00000100:00100000:2.0:1783947465.666899:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:10789:x1870604213971712:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947465.667088:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:10789:x1870604213971712:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 197us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.667098:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 340 00000100:00100000:2.0:1783947465.675297:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947465.675723:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971840 00000100:00100000:3.0:1783947465.675733:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971840 00000100:00100000:3.0:1783947465.676260:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 341 00000100:00100000:3.0:1783947465.676272:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:6179:x1870604213971840:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947465.676291:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947465.676312:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e51000/0xe6fd1fdb555003f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e70 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947465.676341:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e51000/0xe6fd1fdb555003f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e70 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947465.676373:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e51000/0xe6fd1fdb555003f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e70 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947465.676382:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51000, rc 0) 00000100:00100000:3.0:1783947465.676496:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213971840:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 227us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947465.676503:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 341 00000100:00100000:3.0:1783947465.692416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947465.693263:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213971968 00000100:00100000:2.0:1783947465.693280:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213971968 00000100:00100000:2.0:1783947465.693343:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 342 00000100:00100000:2.0:1783947465.693355:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213971968:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947465.694262:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213971968:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 902us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.694273:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 342 00000100:00100000:2.0:1783947465.698128:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947465.698236:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972096 00000100:00100000:3.0:1783947465.698245:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972096 00000100:00100000:3.0:1783947465.698299:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 343 00000100:00100000:3.0:1783947465.698309:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213972096:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947465.698501:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:6179:x1870604213972096:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 192us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947465.698509:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 343 00000100:00100000:3.0:1783947465.701261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947465.701358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972224 00000100:00100000:1.0:1783947465.701371:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972224 00000100:00100000:1.0:1783947465.701448:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 344 00000100:00100000:1.0:1783947465.701494:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:10792:x1870604213972224:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783947465.701660:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:10792:x1870604213972224:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 201us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.701669:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 344 00000100:00100000:0.0:1783947465.705153:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947465.707060:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972352 00000100:00100000:2.0:1783947465.707075:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972352 00000100:00100000:2.0:1783947465.707149:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 345 00000100:00100000:2.0:1783947465.707159:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:10792:x1870604213972352:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947465.707335:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:10792:x1870604213972352:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 177us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947465.707344:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 345 00010000:00010000:2.0:1783947465.908270:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947465.971821:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947465.972500:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236076928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947465.972602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947465.972738:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236076928 00000100:00100000:1.0:1783947465.972749:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236076928 00000100:00100000:1.0:1783947465.973038:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947465.973050:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236076928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947465.973086:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947465.973231:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236076928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 182us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947465.973240:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1783947465.973275:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c91180 x1870604236076928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947465.973295:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236076928:0@lo:13:osp-pre-1-1.0 10000000:01000000:2.0:1783947466.035717:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947466.035753:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc47c2000 from 7 10000000:01000000:2.0:1783947466.035760:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947466.035826:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947466.035855:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947466.035868:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947466.035912:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947466.036133:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947466.036223:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bfcba6900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947466.036644:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077056 00000100:00100000:3.0:1783947466.036655:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077056 00000100:00100000:3.0:1783947466.036726:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783947466.036748:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:6507:x1870604236077056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947466.036770:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947466.036790:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e50400/0xe6fd1fdb55500402 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555003fb expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.036822:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e50400/0xe6fd1fdb55500402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555003fb expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.036844:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e50400/0xe6fd1fdb55500402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555003fb expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.036854:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50400, rc 0) 00000100:00100000:3.0:1783947466.036934:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236077056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947466.036943:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1783947466.037129:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947466.037147:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.037159:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947466.037243:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.037276:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947466.037308:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.037571:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077184 00000100:00100000:1.0:1783947466.037577:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077184 00000100:00100000:1.0:1783947466.037605:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1783947466.037613:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236077184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947466.037744:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236077184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.037751:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1783947466.038420:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.038544:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.038606:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947466.038714:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.038786:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077312 00000100:00100000:1.0:1783947466.038791:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077312 00000100:00100000:1.0:1783947466.038833:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783947466.038848:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236077312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947466.039195:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236077312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 345us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.039203:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1783947466.039390:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947466.040179:0:13787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13787:1870604236077440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947466.040253:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947466.040341:0:13787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bfcba6900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.040392:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077440 00000100:00100000:1.0:1783947466.047306:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077440 00000100:00100000:0.0:1783947466.047832:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1783947466.047848:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:13787:x1870604236077440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947466.048108:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:13787:x1870604236077440:12345-0@lo:502:llog_process_th.0 Request processed in 265us (7854us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.048118:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783947466.048253:0:13787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13787:1870604236077440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947466.048300:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947466.048313:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.048316:0:13787:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947466.048325:0:13787:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bc47c2000 00000020:00000080:2.0:1783947466.048328:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947466.048413:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947466.048417:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.048420:0:13787:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947466.048423:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947466.048425:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.048427:0:13787:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783947466.048430:0:13787:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bc47c2000 00000020:00000080:2.0:1783947466.048441:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783947466.048523:0:13787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13787:1870604236077568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947466.048577:0:13787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.050542:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077568 00000100:00100000:3.0:1783947466.050559:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077568 00000100:00100000:2.0:1783947466.050588:0:13787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947466.050627:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1783947466.050638:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:13787:x1870604236077568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947466.050851:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:13787:x1870604236077568:12345-0@lo:502:llog_process_th.0 Request processed in 215us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947466.050860:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1783947466.050949:0:13787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13787:1870604236077568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947466.050988:0:13787:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947466.050999:0:13787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.051002:0:13787:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783947466.051007:0:13787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783947466.051204:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783947466.051234:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947466.051246:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.051260:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947466.051276:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947466.051279:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bff958800 from 7 10000000:01000000:3.0:1783947466.051282:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947466.051320:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.051328:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.051338:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947466.051360:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947466.051411:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.051442:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac76516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947466.052144:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077696 00000100:00100000:2.0:1783947466.052152:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077696 00000100:00100000:2.0:1783947466.052198:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783947466.052207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:6507:x1870604236077696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947466.052225:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947466.052246:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500409 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947466.052275:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500409 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947466.052287:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500409 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947466.052296:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e600, rc 0) 00000100:00100000:2.0:1783947466.052347:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236077696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947466.052354:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783947466.052414:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947466.052439:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947466.053291:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947466.053410:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947466.054017:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947466.054182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077824 00000100:00100000:0.0:1783947466.054192:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077824 00000100:00100000:0.0:1783947466.054255:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783947466.054266:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236077824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947466.054538:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947466.054564:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947466.054613:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947466.055092:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947466.055155:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947466.055252:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236077824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 988us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.055262:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783947466.055295:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236077952 00000100:00100000:0.0:1783947466.055301:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236077952 00000100:00100000:1.0:1783947466.055340:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1783947466.055352:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236077952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947466.055612:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236077952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.055619:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1783947466.055743:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236077952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947466.056522:0:13789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13789:1870604236078080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947466.056575:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947466.056605:0:13789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.056704:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078080 00000100:00100000:1.0:1783947466.056770:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078080 00000100:00100000:1.0:1783947466.056816:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1783947466.056824:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:13789:x1870604236078080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947466.056936:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:13789:x1870604236078080:12345-0@lo:502:llog_process_th.0 Request processed in 113us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.056944:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1783947466.057577:0:13789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13789:1870604236078080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947466.057609:0:13789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947466.057621:0:13789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.057623:0:13789:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947466.057630:0:13789:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bff958800 00000020:00000080:2.0:1783947466.057633:0:13789:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947466.057697:0:13789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947466.057699:0:13789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.057701:0:13789:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947466.057770:0:13789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947466.057775:0:13789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.057776:0:13789:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783947466.057780:0:13789:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bff958800 00000020:00000080:2.0:1783947466.057782:0:13789:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783947466.057824:0:13789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13789:1870604236078208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947466.058188:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947466.058220:0:13789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3c8cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947466.058817:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078208 00000100:00100000:2.0:1783947466.059138:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078208 00000100:00100000:2.0:1783947466.059192:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1783947466.059202:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:13789:x1870604236078208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947466.059358:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:13789:x1870604236078208:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947466.059367:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1783947466.059436:0:13789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ceb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13789:1870604236078208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947466.060189:0:13789:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947466.060201:0:13789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947466.060203:0:13789:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783947466.060208:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783947466.060427:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783947466.060810:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947466.060826:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947466.060841:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947466.060855:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947466.060864:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7be784d800 from 7 10000000:01000000:1.0:1783947466.060867:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947466.061062:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947466.061072:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947466.061160:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947466.061193:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947466.061267:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947466.061380:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac76833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947466.061616:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078336 00000100:00100000:0.0:1783947466.061626:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078336 00000100:00100000:0.0:1783947466.063882:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1783947466.063908:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:6507:x1870604236078336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947466.063934:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947466.064262:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb5550041e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500417 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.064303:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb5550041e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500417 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.064316:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb5550041e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500417 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.064327:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a000, rc 0) 00000100:00100000:0.0:1783947466.064576:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236078336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 679us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.064587:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1783947466.064782:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947466.064807:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.064818:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947466.064926:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947466.064968:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.065016:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7651d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.065224:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078464 00000100:00100000:1.0:1783947466.065232:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078464 00000100:00100000:1.0:1783947466.065290:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1783947466.065300:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236078464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947466.065517:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236078464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.065525:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1783947466.065562:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783947466.065598:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947466.065657:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947466.065677:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac76833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.065691:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078592 00000100:00100000:1.0:1783947466.065695:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078592 00000100:00100000:3.0:1783947466.065828:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783947466.065837:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236078592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947466.065947:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236078592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947466.065965:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1783947466.066352:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947466.068189:0:13791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13791:1870604236078720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947466.068294:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.068331:0:13791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7651cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.068667:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078720 00000100:00100000:1.0:1783947466.068676:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078720 00000100:00100000:1.0:1783947466.068822:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1783947466.068834:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:13791:x1870604236078720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947466.069195:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:13791:x1870604236078720:12345-0@lo:502:llog_process_th.0 Request processed in 362us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.069204:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783947466.069318:0:13791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13791:1870604236078720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947466.069352:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947466.069365:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947466.069368:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947466.069376:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7be784d800 00000020:00000080:3.0:1783947466.069380:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947466.069623:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947466.069627:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947466.069628:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947466.069631:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947466.069633:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947466.069634:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783947466.069638:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7be784d800 00000020:00000080:3.0:1783947466.069639:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947466.069684:0:13791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13791:1870604236078848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947466.070786:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.070844:0:13791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7651cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947466.071053:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078848 00000100:00100000:0.0:1783947466.071063:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078848 00000100:00100000:0.0:1783947466.071134:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1783947466.071145:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:13791:x1870604236078848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947466.071306:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:13791:x1870604236078848:12345-0@lo:502:llog_process_th.0 Request processed in 163us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.071320:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783947466.071833:0:13791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13791:1870604236078848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947466.071871:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947466.071880:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947466.071883:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783947466.071894:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783947466.072702:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783947466.072798:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947466.072813:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.072827:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947466.072839:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947466.072843:0:6507:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc9511800 from 7 10000000:01000000:0.0:1783947466.072846:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947466.072891:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.072907:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.072918:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947466.072947:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.073674:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947466.073851:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d240 going to sleep for 11 seconds 00000100:00100000:1.0:1783947466.073909:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236078976 00000100:00100000:1.0:1783947466.073918:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236078976 00000100:00100000:1.0:1783947466.074163:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1783947466.074176:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:6507:x1870604236078976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947466.074200:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947466.074221:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac6438400/0xe6fd1fdb5550042c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55500425 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947466.074257:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac6438400/0xe6fd1fdb5550042c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55500425 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947466.074270:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac6438400/0xe6fd1fdb5550042c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55500425 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947466.074280:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438400, rc 0) 00000100:00100000:1.0:1783947466.074341:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236078976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947466.074349:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1783947466.074473:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236078976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947466.074493:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947466.074503:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947466.074592:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236079104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947466.074626:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947466.074966:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7651cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947466.075005:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236079104 00000100:00100000:0.0:1783947466.075010:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236079104 00000100:00100000:0.0:1783947466.075039:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1783947466.075045:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236079104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.075191:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236079104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.075216:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1783947466.075252:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236079104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.075284:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236079232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.075327:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947466.075341:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947466.075351:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236079232 00000100:00100000:0.0:1783947466.075355:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236079232 00000100:00100000:0.0:1783947466.075370:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1783947466.075376:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236079232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.075622:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:6507:x1870604236079232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.075631:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1783947466.075673:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:6507:1870604236079232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947466.075930:0:13792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13792:1870604236079360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947466.076085:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947466.076109:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236079360 00000100:00100000:0.0:1783947466.076113:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236079360 00000100:00100000:0.0:1783947466.076133:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783947466.076140:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:13792:x1870604236079360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947466.076214:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:13792:x1870604236079360:12345-0@lo:502:llog_process_th.0 Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.076221:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783947466.076257:0:13792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947466.076270:0:13792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13792:1870604236079360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947466.076295:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947466.076306:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947466.076309:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783947466.076319:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bc9511800 00000020:00000080:0.0:1783947466.076322:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783947466.076392:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947466.076409:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947466.076410:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783947466.076413:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947466.076416:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947466.076417:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783947466.076431:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bc9511800 00000020:00000080:0.0:1783947466.076433:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783947466.076484:0:13792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13792:1870604236079488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947466.076514:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947466.076532:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236079488 00000100:00100000:0.0:1783947466.076535:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236079488 00000100:00100000:0.0:1783947466.076551:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1783947466.076556:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:13792:x1870604236079488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947466.076614:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:13792:x1870604236079488:12345-0@lo:502:llog_process_th.0 Request processed in 57us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947466.076620:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1783947466.076648:0:13792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947466.076659:0:13792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:13792:1870604236079488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947466.076675:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947466.076679:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947466.076680:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783947466.076684:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783947466.077022:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783947466.077127:0:6507:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947466.077139:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947466.077150:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947466.079817:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783947466.107021:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783947466.932526:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947467.124898:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1783947467.126268:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783947467.509385:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947467.509428:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236079616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947467.509597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947467.509765:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236079616 00000100:00100000:1.0:1783947467.509794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236079616 00000100:00100000:1.0:1783947467.509871:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783947467.509882:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236079616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947467.509933:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783947467.510007:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236079616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947467.510016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783947467.510575:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac712b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236079616:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783947467.956089:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947468.980628:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947469.044163:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236079744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947469.044273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947469.045060:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236079744 00000100:00100000:3.0:1783947469.045074:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236079744 00000100:00100000:3.0:1783947469.045163:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783947469.045177:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604236079744:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783947469.045208:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1783947469.045225:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947469.045302:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604236079744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947469.045311:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783947469.046063:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236079744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947469.048518:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac712bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236079872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947469.048625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947469.048755:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236079872 00000100:00100000:3.0:1783947469.048766:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236079872 00000100:00100000:3.0:1783947469.048849:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783947469.048861:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236079872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947469.048895:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783947469.049063:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947469.053444:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236079872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4567us (4799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947469.053503:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783947469.055919:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac712bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236079872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947469.286775:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947469.286831:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947469.286860:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947469.286900:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947469.286921:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947469.286951:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947469.286989:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972608 00000100:00100000:2.0:1783947469.287001:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972608 00000100:00100000:2.0:1783947469.287079:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213973120 00000100:00100000:2.0:1783947469.287083:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213973120 00000100:00100000:2.0:1783947469.287100:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972736 00000100:00100000:2.0:1783947469.287103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972736 00000100:00100000:2.0:1783947469.287117:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972992 00000100:00100000:2.0:1783947469.287121:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972992 00000100:00100000:2.0:1783947469.287140:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:2.0:1783947469.287151:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213972608:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947469.287370:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972864 00000100:00100000:0.0:1783947469.287375:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972864 00000100:00100000:0.0:1783947469.287418:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 93 00000100:00100000:0.0:1783947469.287426:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213972864:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947469.287549:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213972864:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 123us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947469.287556:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 93 00000100:00100000:0.0:1783947469.287585:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213972480 00000100:00100000:0.0:1783947469.287588:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213972480 00000100:00100000:0.0:1783947469.287614:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 366 00000100:00100000:0.0:1783947469.287621:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604213972480:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947469.287650:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604213972480:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947469.287728:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 366 00000100:00080000:0.0:1783947469.288133:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947469.288143:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947469.288146:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947469.288402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00100000:3.0:1783947469.288415:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213973120:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947469.288487:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213973120:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 76us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947469.288495:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00100000:3.0:1783947469.288516:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 223 00000100:00100000:3.0:1783947469.288523:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213972736:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947469.288558:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213972736:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 35us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947469.288564:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 223 00000100:00100000:3.0:1783947469.288576:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 224 00000100:00100000:3.0:1783947469.288583:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213972992:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947469.288608:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604213972992:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947469.288614:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 224 00000100:00100000:2.0:1783947469.290828:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604213972608:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3657us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947469.290848:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:3.0:1783947469.556059:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236080000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947469.556255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947469.557400:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080000 00000100:00100000:1.0:1783947469.557415:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080000 00000100:00100000:1.0:1783947469.557603:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783947469.557617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236080000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947469.557674:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783947469.558344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236080000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 717us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947469.558355:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783947469.559044:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236080000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783947470.003864:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947470.579807:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236080384:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.579911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947470.579994:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236080896:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947470.580042:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236081408:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947470.580107:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1783947470.580113:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236080256:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947470.580165:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236080768:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580191:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947470.580207:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236081280:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947470.580249:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236081792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580269:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947470.580302:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080384 00000100:00100000:1.0:1783947470.580333:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080384 00000100:00100000:1.0:1783947470.580385:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080896 00000100:00100000:1.0:1783947470.580389:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080896 00000100:00100000:1.0:1783947470.580416:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081408 00000100:00100000:1.0:1783947470.580419:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081408 00000100:00100000:1.0:1783947470.580439:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783947470.580448:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236080384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580538:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236080384:12345-0@lo:400:kworker.0 Request processed in 90us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947470.580547:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783947470.580566:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783947470.580572:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236080896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580598:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236080896:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947470.580604:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783947470.580624:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783947470.580629:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236081408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580655:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236081408:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947470.580660:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783947470.580678:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081280 00000100:00100000:1.0:1783947470.580681:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081280 00000100:00100000:1.0:1783947470.580703:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081792 00000100:00100000:1.0:1783947470.580705:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081792 00000100:00100000:1.0:1783947470.580724:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783947470.580731:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236081280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580760:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236081280:12345-0@lo:400:kworker.0 Request processed in 30us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947470.580765:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783947470.580778:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947470.580784:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236081792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580808:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236081792:12345-0@lo:400:kworker.0 Request processed in 25us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947470.580814:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783947470.580861:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236081280:0@lo:400:kworker.0 00010000:00080000:1.0:1783947470.580876:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e8a80 x1870604236081792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947470.580887:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236081792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580898:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236080384:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580906:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236080896:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.580927:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236081408:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581207:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236080128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947470.581246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947470.581283:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236080640:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581322:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947470.581343:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236081152:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947470.581385:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236081664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947470.581429:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783947470.581436:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236080512:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947470.581530:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236081024:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581555:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947470.581570:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236081536:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947470.581622:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080640 00000100:00100000:0.0:1783947470.581628:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080640 00000100:00100000:0.0:1783947470.581656:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081024 00000100:00100000:0.0:1783947470.581658:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081024 00000100:00100000:0.0:1783947470.581674:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081536 00000100:00100000:0.0:1783947470.581692:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081536 00000100:00100000:0.0:1783947470.581713:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783947470.581721:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236080640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581765:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236080640:12345-0@lo:400:kworker.0 Request processed in 45us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947470.581771:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783947470.581796:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783947470.581801:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236081024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581827:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236081024:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947470.581833:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783947470.581843:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1783947470.581849:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236081536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.581874:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236081536:12345-0@lo:400:kworker.0 Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947470.581880:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1783947470.581900:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947470.581906:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947470.581909:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947470.581920:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081152 00000100:00100000:0.0:1783947470.581924:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081152 00000100:00100000:0.0:1783947470.581941:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081664 00000100:00100000:0.0:1783947470.581943:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081664 00000100:00100000:0.0:1783947470.581962:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783947470.581968:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236081152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.582000:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236081152:12345-0@lo:400:kworker.0 Request processed in 32us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947470.582007:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783947470.582018:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783947470.582024:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236081664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.582048:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236081664:12345-0@lo:400:kworker.0 Request processed in 25us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947470.582054:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1783947470.582107:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783947470.582145:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c92680 x1870604236081024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947470.582159:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236081024:0@lo:400:kworker.0 00010000:00080000:0.0:1783947470.582247:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77ea680 x1870604236081536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947470.582257:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236081536:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.582270:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236080640:0@lo:400:kworker.0 00000100:00100000:0.0:1783947470.582280:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236081152:0@lo:400:kworker.0 00010000:00080000:0.0:1783947470.582288:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77eaa00 x1870604236081664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947470.582296:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236081664:0@lo:400:kworker.0 00000100:00100000:3.0:1783947470.583067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080256 00000100:00100000:3.0:1783947470.583077:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080256 00000100:00100000:3.0:1783947470.583123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1783947470.583131:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236080256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947470.583205:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236080256:12345-0@lo:400:kworker.0 Request processed in 75us (3059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947470.583221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1783947470.583278:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236080256:0@lo:400:kworker.0 00000100:00100000:2.0:1783947470.585732:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080768 00000100:00100000:2.0:1783947470.585755:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080768 00000100:00100000:2.0:1783947470.585814:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080512 00000100:00100000:2.0:1783947470.585818:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080512 00000100:00100000:2.0:1783947470.585852:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783947470.585864:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236080768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947470.585990:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236080768:12345-0@lo:400:kworker.0 Request processed in 128us (5797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947470.586011:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783947470.586029:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783947470.586036:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236080512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947470.586078:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236080512:12345-0@lo:400:kworker.0 Request processed in 42us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947470.586085:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783947470.586181:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236080512:0@lo:400:kworker.0 00000100:00100000:3.0:1783947470.586215:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236080768:0@lo:400:kworker.0 00000100:00100000:1.0:1783947470.586921:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236080128 00000100:00100000:1.0:1783947470.586932:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236080128 00000100:00100000:1.0:1783947470.587000:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783947470.587009:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236080128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947470.587050:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947470.587121:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236080128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (5874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947470.587128:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1783947470.589023:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c92300 x1870604236080128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947470.589061:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236080128:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1783947470.589935:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:0.0:1783947471.030650:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947471.092120:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236081920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947471.092201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947471.092333:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236081920 00000100:00100000:1.0:1783947471.092343:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236081920 00000100:00100000:1.0:1783947471.092398:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783947471.092407:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236081920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947471.092432:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947471.092498:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236081920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947471.092581:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1783947471.092619:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9500 x1870604236081920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947471.092638:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236081920:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783947472.063008:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947472.627812:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236082048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947472.627989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947472.628211:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082048 00000100:00100000:0.0:1783947472.628220:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082048 00000100:00100000:0.0:1783947472.628310:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783947472.628324:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236082048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947472.628379:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947472.628452:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236082048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947472.628498:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783947472.628787:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236082048:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947473.077868:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947474.102493:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947474.163875:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236082176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947474.164009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947474.164231:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082176 00000100:00100000:3.0:1783947474.164251:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082176 00000100:00100000:3.0:1783947474.164329:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783947474.164344:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236082176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947474.164389:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947474.164451:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236082176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947474.164511:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783947474.164665:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236082304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947474.164711:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1783947474.164719:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7bf7ce8700, transno 4294967301 00000100:00100000:2.0:1783947474.164741:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236082176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783947474.167475:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947474.177596:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947474.179874:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082304 00000100:00100000:0.0:1783947474.179898:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082304 00000100:00100000:0.0:1783947474.180009:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783947474.180022:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236082304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947474.180421:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1783947474.180692:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947474.181199:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236082304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1174us (3622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947474.181212:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783947474.181962:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236082304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947474.411080:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947474.411171:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947474.411213:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947474.411257:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947474.411281:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947474.411311:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213973504 00000100:00100000:2.0:1783947474.411313:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947474.411327:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213973504 00000100:00100000:2.0:1783947474.411363:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213973760 00000100:00100000:2.0:1783947474.411368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213973760 00000100:00100000:0.0:1783947474.411444:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213973376 00000100:00100000:0.0:1783947474.411449:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213973376 00000100:00100000:3.0:1783947474.411587:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213973888 00000100:00100000:3.0:1783947474.411592:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213973888 00000100:00100000:2.0:1783947474.412540:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 231 00000100:00100000:2.0:1783947474.412557:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213973504:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947474.412742:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00100000:0.0:1783947474.412750:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213973760:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947474.412856:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213973760:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 106us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947474.412875:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00100000:0.0:1783947474.412896:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 233 00000100:00100000:0.0:1783947474.412902:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213973376:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947474.412930:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213973376:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947474.412936:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 233 00000100:00100000:0.0:1783947474.412968:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213973632 00000100:00100000:0.0:1783947474.412974:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213973632 00000100:00100000:0.0:1783947474.413011:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:0.0:1783947474.413017:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213973632:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947474.413047:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213973632:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 30us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947474.413071:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:1.0:1783947474.413498:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213973248 00000100:00100000:1.0:1783947474.413504:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213973248 00000100:00080000:1.0:1783947474.413540:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947474.413546:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947474.413548:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947474.413728:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213973504:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1175us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947474.413736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 231 00000100:00100000:0.0:1783947474.413956:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 368 00000100:00100000:0.0:1783947474.413963:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213973248:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947474.414262:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213973248:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 299us (3199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947474.414271:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 368 00000100:00100000:3.0:1783947474.425884:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 234 00000100:00100000:3.0:1783947474.425904:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213973888:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947474.426027:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213973888:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 129us (14713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947474.426035:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 234 00000100:00100000:3.0:1783947474.677167:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947474.677210:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236082432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947474.677322:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947474.677558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082432 00000100:00100000:0.0:1783947474.677569:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082432 00000100:00100000:0.0:1783947474.677645:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783947474.677657:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236082432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947474.677703:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947474.677782:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236082432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947474.677791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783947474.678045:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236082432:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947475.123745:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947475.701818:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236082560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947475.701998:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947475.702104:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082560 00000100:00100000:1.0:1783947475.702113:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082560 00000100:00100000:1.0:1783947475.702179:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783947475.702191:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236082560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947475.702237:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947475.702291:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236082560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947475.702299:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1783947475.702325:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947475.702360:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac77e9180 x1870604236082560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947475.702381:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236082560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947475.704114:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236082816:0@lo:400:kworker.0 00000100:00100000:3.0:1783947475.704194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947475.704255:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236083328:0@lo:400:kworker.0 00000100:00100000:3.0:1783947475.704283:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947475.704306:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236083840:0@lo:400:kworker.0 00000100:00100000:3.0:1783947475.704327:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947475.704355:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082816 00000100:00100000:3.0:1783947475.704357:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783947475.704362:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc47a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236082944:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.704364:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082816 00000100:00100000:3.0:1783947475.704389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947475.704405:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236083456:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.704416:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083328 00000100:00100000:0.0:1783947475.704418:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083328 00000100:00100000:3.0:1783947475.704426:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947475.704438:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083840 00000100:00100000:3.0:1783947475.704440:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236083968:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.704441:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083840 00000100:00100000:0.0:1783947475.704470:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083456 00000100:00100000:0.0:1783947475.704474:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083456 00000100:00100000:0.0:1783947475.704492:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783947475.704499:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947475.704502:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236082816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947475.704525:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083968 00000100:00100000:3.0:1783947475.704529:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083968 00000100:00100000:3.0:1783947475.704554:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783947475.704560:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236083328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.705095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082944 00000100:00100000:1.0:1783947475.705102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082944 00000100:00100000:1.0:1783947475.705143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783947475.705151:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236082944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.709664:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236082816:12345-0@lo:400:kworker.0 Request processed in 5146us (5453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947475.709702:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783947475.717397:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236082944:12345-0@lo:400:kworker.0 Request processed in 12227us (12987us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947475.717422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783947475.717557:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236082688:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.717652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947475.717729:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236083200:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.717760:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947475.717781:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236083712:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.717809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947475.717848:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783947475.717856:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236083072:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.717885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947475.717977:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236083584:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718065:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947475.718087:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236084096:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947475.718143:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236082688 00000100:00100000:1.0:1783947475.718152:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236082688 00000100:00100000:1.0:1783947475.718207:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1783947475.718229:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236082688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718292:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236082688:12345-0@lo:400:kworker.0 Request processed in 65us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947475.718299:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1783947475.718331:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083200 00000100:00100000:1.0:1783947475.718335:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083200 00000100:00100000:1.0:1783947475.718360:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783947475.718366:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236083200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718402:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236083200:12345-0@lo:400:kworker.0 Request processed in 36us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947475.718419:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783947475.718439:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083712 00000100:00100000:1.0:1783947475.718443:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083712 00000100:00100000:1.0:1783947475.718496:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083584 00000100:00100000:1.0:1783947475.718499:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083584 00000100:00100000:1.0:1783947475.718516:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084096 00000100:00100000:1.0:1783947475.718518:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084096 00000100:00100000:1.0:1783947475.718537:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783947475.718543:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236083712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718576:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236083712:12345-0@lo:400:kworker.0 Request processed in 33us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947475.718582:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783947475.718593:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783947475.718599:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236083584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718626:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236083584:12345-0@lo:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947475.718632:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783947475.718642:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783947475.718647:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236084096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718674:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236084096:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947475.718679:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1783947475.718701:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947475.718707:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947475.718711:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947475.718732:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236083072 00000100:00100000:0.0:1783947475.718736:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236083072 00000100:00100000:1.0:1783947475.718767:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236083584:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.718771:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783947475.718779:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236083840:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1783947475.718781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac771aa00 x1870604236084096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947475.718798:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236084096:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718809:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236082688:0@lo:400:kworker.0 00000100:00100000:1.0:1783947475.718818:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236083200:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.718819:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236083840:12345-0@lo:400:kworker.0 Request processed in 41us (14490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947475.718825:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783947475.718828:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236083712:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.718838:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783947475.718844:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236083456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.718872:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236083456:12345-0@lo:400:kworker.0 Request processed in 29us (14445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947475.718878:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783947475.718891:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783947475.718897:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc55bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236083968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.718927:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc55bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236083968:12345-0@lo:400:kworker.0 Request processed in 30us (14427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947475.718932:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783947475.718946:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783947475.718952:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236083072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.718990:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236083072:12345-0@lo:400:kworker.0 Request processed in 38us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947475.719011:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783947475.719039:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236083072:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.719118:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc47a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236082944:0@lo:400:kworker.0 00010000:00080000:0.0:1783947475.719131:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c6dc00 x1870604236083456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947475.719142:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236083456:0@lo:400:kworker.0 00010000:00080000:0.0:1783947475.719155:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7719180 x1870604236083968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947475.719164:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236083968:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.719179:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236082816:0@lo:400:kworker.0 00000100:00100000:0.0:1783947475.719191:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236083840:0@lo:400:kworker.0 00000100:00100000:3.0:1783947475.720121:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236083328:12345-0@lo:400:kworker.0 Request processed in 15550us (15828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947475.720135:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783947475.723354:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236083328:0@lo:400:kworker.0 00010000:00010000:1.0:1783947476.150192:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947476.212143:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947476.212173:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236084224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947476.212268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947476.213077:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084224 00000100:00100000:1.0:1783947476.213088:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084224 00000100:00100000:1.0:1783947476.213148:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783947476.213158:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236084224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947476.213190:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947476.213270:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236084224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947476.213278:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1783947476.213328:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cb8a80 x1870604236084224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947476.213348:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236084224:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783947477.175146:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947477.364396:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783947477.364396:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783947477.756825:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947477.769614:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac712aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236084352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947477.769724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947477.770276:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084352 00000100:00100000:1.0:1783947477.770285:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084352 00000100:00100000:1.0:1783947477.770342:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783947477.770352:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236084352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947477.770392:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783947477.770491:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236084352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947477.770517:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783947477.771698:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac712aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236084352:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783947478.195622:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947479.219731:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947479.283816:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236084480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947479.283906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947479.284025:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084480 00000100:00100000:0.0:1783947479.284035:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084480 00000100:00100000:0.0:1783947479.284101:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783947479.284112:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236084480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947479.284156:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1783947479.284491:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947479.284948:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947479.284961:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236084608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947479.284995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947479.285026:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1783947479.285034:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1783947479.285152:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084608 00000100:00100000:1.0:1783947479.285158:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084608 00000100:00100000:1.0:1783947479.285263:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783947479.285271:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236084608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947479.285287:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947479.285324:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236084608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947479.285331:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783947479.285376:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236084608:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783947479.285993:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947479.290874:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236084480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6701us (6905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947479.290890:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783947479.292795:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236084480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947479.527409:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947479.527540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974016 00000100:00100000:2.0:1783947479.527551:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974016 00000100:00100000:2.0:1783947479.527616:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 370 00000100:00100000:2.0:1783947479.527630:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213974016:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947479.527919:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213974016:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 293us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947479.527928:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 370 00000100:00100000:3.0:1783947479.528872:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947479.529020:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947479.529166:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974272 00000100:00100000:1.0:1783947479.529176:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974272 00000100:00100000:1.0:1783947479.529233:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974144 00000100:00100000:1.0:1783947479.529236:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974144 00000100:00100000:1.0:1783947479.529258:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:1.0:1783947479.529268:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213974272:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947479.529340:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213974272:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 74us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947479.529348:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:1.0:1783947479.529368:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00080000:3.0:1783947479.529509:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947479.529514:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947479.529642:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213974144:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947479.529682:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213974144:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 44us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947479.538276:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:0.0:1783947479.552189:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947479.552223:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947479.552230:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974400 00000100:00100000:1.0:1783947479.552243:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974400 00000100:00100000:0.0:1783947479.552261:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947479.552300:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974528 00000100:00100000:0.0:1783947479.552305:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974528 00000100:00100000:1.0:1783947479.552322:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:1.0:1783947479.552334:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2405:x1870604213974400:12345-192.168.204.3@tcp:9:kworker.0 00000100:00100000:0.0:1783947479.552356:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974656 00000100:00100000:0.0:1783947479.552360:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974656 00000020:00000080:1.0:1783947479.552368:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500353 00000100:00080000:1.0:1783947479.552378:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e7ac674f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783947479.552384:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:0.0:1783947479.552393:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213974528:12345-192.168.204.3@tcp:400:kworker.0 00000001:00000004:1.0:1783947479.552438:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1783947479.552563:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:2.0:1783947479.552573:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213974656:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947479.552655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213974528:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 263us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947479.552663:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00080000:3.0:1783947479.552680:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947479.552687:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947479.552691:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947479.552942:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213974656:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 371us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947479.552950:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:1.0:1783947479.552964:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+2:2405:x1870604213974400:12345-192.168.204.3@tcp:9:kworker.0 Request processed in 631us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947479.552972:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00010000:00010000:3.0:1783947479.553043:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947479.801589:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236084736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947479.801672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947479.802267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084736 00000100:00100000:1.0:1783947479.802284:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084736 00000100:00100000:1.0:1783947479.802385:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783947479.802397:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236084736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947479.802436:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783947479.802537:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236084736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947479.802544:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783947479.802658:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236084736:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783947480.247212:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947480.819993:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236085120:0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947480.820156:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236085632:0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947480.820200:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236086144:0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947480.820268:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783947480.820274:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236085248:0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947480.820312:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236085760:0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947480.820349:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236086272:0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947480.820393:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236085760 00000100:00100000:0.0:1783947480.820399:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236085760 00000100:00100000:0.0:1783947480.820493:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086272 00000100:00100000:0.0:1783947480.820497:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086272 00000100:00100000:0.0:1783947480.820528:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783947480.820536:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236085760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820609:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236085760:12345-0@lo:400:kworker.0 Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947480.820617:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783947480.820635:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783947480.820641:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236086272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820666:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7129880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236086272:12345-0@lo:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947480.820671:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783947480.820695:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236085632 00000100:00100000:0.0:1783947480.820699:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236085632 00000100:00100000:0.0:1783947480.820723:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086144 00000100:00100000:0.0:1783947480.820725:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086144 00000100:00100000:0.0:1783947480.820738:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236085248 00000100:00100000:0.0:1783947480.820740:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236085248 00000100:00100000:0.0:1783947480.820751:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783947480.820755:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236085632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820786:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236085632:12345-0@lo:400:kworker.0 Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947480.820791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783947480.820802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783947480.820808:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236086144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820833:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236086144:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947480.820838:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783947480.820849:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783947480.820854:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236085248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820890:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236085248:12345-0@lo:400:kworker.0 Request processed in 35us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947480.820896:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783947480.820941:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236085248:0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.820951:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236085760:0@lo:400:kworker.0 00010000:00080000:0.0:1783947480.820964:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c25c00 x1870604236086272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947480.820974:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236086272:0@lo:400:kworker.0 00010000:00080000:0.0:1783947480.820983:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c25f80 x1870604236085632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947480.820990:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236085632:0@lo:400:kworker.0 00010000:00080000:0.0:1783947480.820999:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c25500 x1870604236086144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947480.821007:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236086144:0@lo:400:kworker.0 00000100:00100000:2.0:1783947480.821148:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236085120 00000100:00100000:2.0:1783947480.821153:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236085120 00000100:00100000:2.0:1783947480.821189:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783947480.821195:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236085120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947480.821236:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236085120:12345-0@lo:400:kworker.0 Request processed in 41us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947480.821241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783947480.821264:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236085120:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.822098:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236084992:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.822156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947480.822196:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236085504:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.822226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947480.822253:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236086016:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.822275:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947480.822296:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783947480.822302:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236084864:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.822341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947480.822361:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236085376:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.822383:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947480.822397:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236085888:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.822421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947480.822439:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236086400:0@lo:400:kworker.0 00000100:00100000:2.0:1783947480.822529:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084992 00000100:00100000:2.0:1783947480.822535:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084992 00000100:00100000:2.0:1783947480.822576:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236085504 00000100:00100000:2.0:1783947480.822578:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236085504 00000100:00100000:2.0:1783947480.822594:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086016 00000100:00100000:2.0:1783947480.822597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086016 00000100:00100000:2.0:1783947480.822619:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783947480.822626:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236084992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947480.822667:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236084992:12345-0@lo:400:kworker.0 Request processed in 41us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947480.822673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783947480.822687:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783947480.822692:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac646ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236085504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947480.822717:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac646ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236085504:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947480.822723:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783947480.822734:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783947480.822739:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236086016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947480.822773:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236086016:12345-0@lo:400:kworker.0 Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947480.822779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:2.0:1783947480.822817:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947480.822821:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947480.822824:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947480.822848:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236085888 00000100:00100000:2.0:1783947480.822851:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236085888 00000100:00100000:2.0:1783947480.822871:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783947480.822877:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236085888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947480.823161:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236085888:12345-0@lo:400:kworker.0 Request processed in 283us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947480.823168:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783947480.823411:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236085376 00000100:00100000:0.0:1783947480.823416:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236085376 00000100:00100000:1.0:1783947480.823769:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236084864 00000100:00100000:1.0:1783947480.823774:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236084864 00000100:00100000:1.0:1783947480.823852:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1783947480.823859:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236084864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947480.823921:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc64d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236084864:12345-0@lo:400:kworker.0 Request processed in 62us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947480.823928:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1783947480.824151:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947480.824162:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236086528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947480.824191:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947480.824345:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783947480.824353:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236085376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947480.824391:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236085376:12345-0@lo:400:kworker.0 Request processed in 40us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947480.824396:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783947480.824722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947480.824910:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086528 00000100:00100000:1.0:1783947480.824915:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086528 00000100:00100000:1.0:1783947480.824962:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783947480.824968:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236086528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947480.824991:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947480.825025:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236086528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947480.825031:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1783947480.825046:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947480.825083:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cbb800 x1870604236086528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947480.825100:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236086528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947480.825145:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086400 00000100:00100000:1.0:1783947480.825149:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086400 00000100:00100000:1.0:1783947480.825173:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783947480.825178:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236086400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947480.825207:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236086400:12345-0@lo:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947480.825224:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1783947480.832888:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c26d80 x1870604236086400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947480.832911:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236086400:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.832929:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236084992:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.833004:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236085504:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.833022:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236086016:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.833061:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236084864:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.833079:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236085376:0@lo:400:kworker.0 00000100:00100000:3.0:1783947480.833092:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236085888:0@lo:400:kworker.0 00010000:00010000:2.0:1783947481.267641:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947481.331905:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947481.331931:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236086656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947481.332005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947481.332129:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086656 00000100:00100000:0.0:1783947481.332138:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086656 00000100:00100000:0.0:1783947481.332318:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783947481.332329:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236086656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947481.332354:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947481.332413:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236086656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947481.332420:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1783947481.332498:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7cbb800 x1870604236086656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947481.332518:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236086656:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947482.298821:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947482.868295:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947482.868339:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236086784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947482.868423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947482.868597:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086784 00000100:00100000:0.0:1783947482.868605:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086784 00000100:00100000:0.0:1783947482.868667:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783947482.868678:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236086784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947482.868717:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947482.868779:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236086784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947482.868787:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783947482.868842:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236086784:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947483.316629:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947484.340106:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947484.406120:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947484.406144:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236086912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947484.406220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947484.406300:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236086912 00000100:00100000:3.0:1783947484.406309:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236086912 00000100:00100000:3.0:1783947484.406368:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783947484.406377:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236086912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947484.406409:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947484.406484:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236086912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947484.406492:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1783947484.406513:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947484.406552:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236086912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947484.407028:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947484.407039:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236087040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947484.407086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947484.407254:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087040 00000100:00100000:1.0:1783947484.407260:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087040 00000100:00100000:1.0:1783947484.407322:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783947484.407331:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236087040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947484.407346:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947484.407385:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236087040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947484.407391:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783947484.407517:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236087040:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1783947484.407650:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947484.647438:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947484.647540:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947484.647559:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947484.647593:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947484.647598:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974784 00000100:00100000:0.0:1783947484.647608:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974784 00000100:00100000:3.0:1783947484.647617:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947484.647663:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 372 00000100:00100000:0.0:1783947484.647673:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213974784:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947484.647769:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604213974784:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 97us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947484.647781:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 372 00000100:00100000:2.0:1783947484.647934:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975040 00000100:00100000:2.0:1783947484.647940:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975040 00000100:00100000:3.0:1783947484.647978:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975296 00000100:00100000:3.0:1783947484.647981:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975296 00000100:00100000:2.0:1783947484.647986:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213974912 00000100:00100000:2.0:1783947484.647988:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213974912 00000100:00100000:3.0:1783947484.648000:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975168 00000100:00100000:3.0:1783947484.648002:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975168 00000100:00100000:2.0:1783947484.648003:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 251 00000100:00100000:2.0:1783947484.648009:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213975040:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947484.648014:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 252 00000100:00100000:3.0:1783947484.648020:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213975296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947484.648058:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213975040:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 49us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947484.648059:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213975296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947484.648065:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 251 00000100:00100000:3.0:1783947484.648081:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 252 00000100:00100000:2.0:1783947484.648089:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00100000:3.0:1783947484.648092:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 254 00000100:00100000:2.0:1783947484.648095:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213974912:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947484.648098:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213975168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947484.648119:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604213975168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 21us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947484.648125:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 254 00000100:00080000:0.0:1783947484.648147:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947484.648152:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947484.651848:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213974912:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3737us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947484.651864:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00100000:2.0:1783947484.915787:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236087168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947484.915907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947484.916105:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087168 00000100:00100000:1.0:1783947484.916114:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087168 00000100:00100000:1.0:1783947484.916175:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783947484.916184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236087168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947484.916219:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783947484.916268:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236087168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947484.916275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783947484.916965:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236087168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783947485.364223:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947485.939601:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947485.939625:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236087296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947485.939692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947485.939756:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087296 00000100:00100000:1.0:1783947485.939762:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087296 00000100:00100000:1.0:1783947485.939806:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783947485.939815:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236087296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947485.939842:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947485.939890:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236087296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.939897:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1783947485.939934:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac771aa00 x1870604236087296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947485.939951:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236087296:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783947485.940148:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947485.941253:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236087808:0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.941297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947485.941325:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236088320:0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.941344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947485.941360:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236088832:0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.941379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947485.941395:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783947485.941400:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236087680:0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.941418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947485.941431:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236088192:0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.941450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947485.941480:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236088704:0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.941507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947485.941530:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088320 00000100:00100000:1.0:1783947485.941534:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088320 00000100:00100000:3.0:1783947485.941721:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236087552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.941750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947485.941769:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236088064:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.941785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947485.941801:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236088576:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.941816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947485.941829:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783947485.941834:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac771aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236087424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.941855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947485.941871:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236087936:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.941887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947485.941900:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236088448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.941915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947485.941936:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087808 00000100:00100000:3.0:1783947485.941939:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087808 00000100:00100000:3.0:1783947485.941966:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088192 00000100:00100000:3.0:1783947485.941968:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088192 00000100:00100000:3.0:1783947485.941984:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088704 00000100:00100000:3.0:1783947485.941994:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088704 00000100:00100000:3.0:1783947485.942006:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087552 00000100:00100000:3.0:1783947485.942008:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087552 00000100:00100000:3.0:1783947485.942032:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088064 00000100:00100000:3.0:1783947485.942035:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088064 00000100:00100000:3.0:1783947485.942046:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088576 00000100:00100000:3.0:1783947485.942048:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088576 00000100:00100000:3.0:1783947485.942060:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783947485.942066:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236087808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.942117:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236087808:12345-0@lo:400:kworker.0 Request processed in 51us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.942124:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783947485.942138:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783947485.942144:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236088192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.942171:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236088192:12345-0@lo:400:kworker.0 Request processed in 28us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.942177:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783947485.942251:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783947485.942258:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236088704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.942286:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236088704:12345-0@lo:400:kworker.0 Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.942291:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783947485.942300:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783947485.942306:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236087552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.942337:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236087552:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.942342:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783947485.942361:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783947485.942367:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236088064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.942397:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236088064:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.942402:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783947485.942412:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783947485.942418:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236088576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.942440:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236088576:12345-0@lo:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.942444:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783947485.942660:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088832 00000100:00100000:1.0:1783947485.942664:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088832 00000100:00100000:1.0:1783947485.942681:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088448 00000100:00100000:1.0:1783947485.942683:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088448 00000100:00100000:1.0:1783947485.942695:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783947485.942708:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236088320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.942739:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236088320:12345-0@lo:400:kworker.0 Request processed in 33us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.942745:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783947485.942772:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783947485.942778:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236088832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.942806:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236088832:12345-0@lo:400:kworker.0 Request processed in 28us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.942811:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783947485.942821:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783947485.942827:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236088448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.942853:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236088448:12345-0@lo:400:kworker.0 Request processed in 27us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.942859:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783947485.942876:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087680 00000100:00100000:1.0:1783947485.942879:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087680 00000100:00100000:1.0:1783947485.942899:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087936 00000100:00100000:1.0:1783947485.942902:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087936 00000100:00100000:1.0:1783947485.942914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783947485.942920:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236087680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.942949:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236087680:12345-0@lo:400:kworker.0 Request processed in 29us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.942954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783947485.942965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783947485.942969:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236087936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947485.942995:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236087936:12345-0@lo:400:kworker.0 Request processed in 25us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947485.943007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783947485.943267:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236087424 00000100:00100000:3.0:1783947485.943272:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236087424 00000100:00100000:3.0:1783947485.943316:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1783947485.943322:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236087424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.943357:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236087424:12345-0@lo:400:kworker.0 Request processed in 35us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947485.943363:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:3.0:1783947485.943405:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947485.943411:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947485.943413:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947485.943442:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac771aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236087424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.943475:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236087936:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.943488:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236088448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.944079:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236087552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.944098:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236088064:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.944122:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236088576:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.946272:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236087680:0@lo:400:kworker.0 00010000:00080000:3.0:1783947485.946318:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c92300 x1870604236088192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947485.946331:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236088192:0@lo:400:kworker.0 00010000:00080000:3.0:1783947485.946344:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c90a80 x1870604236088704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947485.946353:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236088704:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.946366:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236087808:0@lo:400:kworker.0 00000100:00100000:3.0:1783947485.946377:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236088320:0@lo:400:kworker.0 00010000:00080000:3.0:1783947485.946389:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c93480 x1870604236088832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947485.946396:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236088832:0@lo:400:kworker.0 00000001:00100000:1.0:1783947485.953296:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:1.0:1783947485.953312:0:8421:0:(genops.c:906:class_export_put()) final put ffff9e7ac73cc000/1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:3.0:1783947485.954147:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac73cc000/1eb923ac-790a-478f-897e-124614dbce09 for lustre-OST0000 00000020:00000080:3.0:1783947485.954211:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac674f000 for lustre-OST0000 00010000:00010000:0.0:1783947486.388138:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947486.451653:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947486.451679:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236088960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947486.451749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947486.451945:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236088960 00000100:00100000:3.0:1783947486.451953:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236088960 00000100:00100000:3.0:1783947486.452016:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783947486.452025:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236088960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947486.452048:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947486.452091:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236088960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947486.452110:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1783947486.452251:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc4746680 x1870604236088960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947486.452269:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236088960:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783947487.412869:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947487.604817:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783947487.605957:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947487.988866:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236089088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947487.988941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947487.989041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089088 00000100:00100000:2.0:1783947487.989054:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089088 00000100:00100000:2.0:1783947487.989107:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783947487.989116:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236089088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947487.989156:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783947487.996530:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236089088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7400us (7574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947487.996545:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783947488.000515:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236089088:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947488.443452:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947489.459642:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947489.524366:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236089344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947489.524472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947489.524544:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947489.524552:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236089216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947489.524576:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947489.524630:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089344 00000100:00100000:3.0:1783947489.524639:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089344 00000100:00100000:1.0:1783947489.524642:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089216 00000100:00100000:1.0:1783947489.524645:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089216 00000100:00100000:3.0:1783947489.524718:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783947489.524728:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236089344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947489.524756:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947489.524801:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236089344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947489.524809:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783947489.524854:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236089344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947489.535643:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783947489.535661:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236089216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947489.535690:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947489.535787:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236089216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (11209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947489.535795:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783947489.535968:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236089216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783947489.536248:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947489.766313:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947489.766378:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947489.766408:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947489.766436:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947489.766485:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947489.766509:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975680 00000100:00100000:0.0:1783947489.766519:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975680 00000100:00100000:0.0:1783947489.766573:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975936 00000100:00100000:0.0:1783947489.766576:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975936 00000100:00100000:0.0:1783947489.766590:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975552 00000100:00100000:0.0:1783947489.766592:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975552 00000100:00100000:0.0:1783947489.766603:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975808 00000100:00100000:0.0:1783947489.766605:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975808 00000100:00100000:0.0:1783947489.766622:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 261 00000100:00100000:0.0:1783947489.766632:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213975680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947489.766704:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213975680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 74us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947489.766712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 261 00000100:00100000:0.0:1783947489.766729:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 262 00000100:00100000:0.0:1783947489.766744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213975936:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947489.766775:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213975936:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947489.766782:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 262 00000100:00100000:0.0:1783947489.766796:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 263 00000100:00100000:0.0:1783947489.766803:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213975552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947489.766830:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604213975552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947489.766836:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 263 00000100:00100000:0.0:1783947489.766848:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 264 00000100:00100000:0.0:1783947489.766855:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213975808:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947489.766881:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213975808:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947489.766887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 264 00000100:00080000:0.0:1783947489.766911:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947489.766915:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947489.767600:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213975424 00000100:00100000:1.0:1783947489.767607:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213975424 00000100:00100000:1.0:1783947489.767649:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 374 00000100:00100000:1.0:1783947489.767657:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213975424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947489.767701:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213975424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 45us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947489.767708:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 374 00000100:00100000:0.0:1783947490.038274:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947490.038299:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236089472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947490.038372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947490.038510:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089472 00000100:00100000:1.0:1783947490.038519:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089472 00000100:00100000:1.0:1783947490.038675:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947490.038684:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc47a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236089472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947490.038721:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783947490.038772:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc47a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236089472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947490.038778:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947490.038829:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236089472:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947490.486563:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947491.060442:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236089600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947491.060616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947491.060727:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089600 00000100:00100000:1.0:1783947491.060735:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089600 00000100:00100000:1.0:1783947491.060806:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783947491.060817:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236089600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947491.060847:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783947491.060952:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947491.062603:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236089856:0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.062680:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236089728:0@lo:400:kworker.0 00000100:00100000:3.0:1783947491.062766:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236089984:0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.066955:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236089600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6127us (6326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947491.066971:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783947491.067053:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236090112:0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.067100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947491.067147:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236090624:0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.067177:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947491.067196:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236091136:0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.067218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783947491.067254:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7cdce00 x1870604236089600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947491.067396:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947491.067423:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236090368:0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.067446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947491.067496:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236090880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.067826:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947491.067864:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236090112 00000100:00100000:2.0:1783947491.067870:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236090112 00000100:00100000:2.0:1783947491.067931:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089856 00000100:00100000:2.0:1783947491.067935:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089856 00000100:00100000:2.0:1783947491.067948:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236090368 00000100:00100000:2.0:1783947491.067951:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236090368 00000100:00100000:2.0:1783947491.067972:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236090880 00000100:00100000:2.0:1783947491.067975:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236090880 00000100:00100000:2.0:1783947491.067990:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783947491.067997:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236090112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.068046:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236090112:12345-0@lo:400:kworker.0 Request processed in 49us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947491.068052:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783947491.068066:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783947491.068071:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236089856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.068098:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236089856:12345-0@lo:400:kworker.0 Request processed in 26us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947491.068103:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783947491.068114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1783947491.068120:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236090368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.068146:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236090368:12345-0@lo:400:kworker.0 Request processed in 26us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947491.068166:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1783947491.068178:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1783947491.068183:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236090880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.068211:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236090880:12345-0@lo:400:kworker.0 Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947491.068217:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1783947491.068234:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947491.068256:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236090880:0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.068348:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7cdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236089600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947491.068375:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236090112:0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.068401:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236090624 00000100:00100000:1.0:1783947491.068404:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236090624 00000100:00100000:1.0:1783947491.068435:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091136 00000100:00100000:1.0:1783947491.068438:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091136 00000100:00100000:2.0:1783947491.068671:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236089856:0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.068684:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236090368:0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.068858:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783947491.068870:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236090624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.068922:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236090624:12345-0@lo:400:kworker.0 Request processed in 45us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947491.068935:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783947491.068950:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783947491.068956:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236091136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.068998:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236091136:12345-0@lo:400:kworker.0 Request processed in 42us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947491.069004:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1783947491.069022:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947491.069025:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947491.069050:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236090624:0@lo:400:kworker.0 00010000:00080000:1.0:1783947491.069062:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc942b800 x1870604236091136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947491.069070:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236091136:0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.072162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947491.072215:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236090240:0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.072250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947491.072290:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236090752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.072315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947491.072349:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236090752 00000100:00100000:0.0:1783947491.072355:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236090752 00000100:00100000:0.0:1783947491.072408:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783947491.072416:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236090752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.072488:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236090752:12345-0@lo:400:kworker.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947491.072496:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1783947491.072525:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947491.072554:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236090752:0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.073088:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236090240 00000100:00100000:2.0:1783947491.073094:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236090240 00000100:00100000:2.0:1783947491.073137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783947491.073144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236090240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947491.073191:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236090240:12345-0@lo:400:kworker.0 Request processed in 47us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947491.073198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783947491.073271:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089728 00000100:00100000:1.0:1783947491.073286:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089728 00000100:00100000:1.0:1783947491.073322:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1783947491.073329:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236089728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.073365:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236089728:12345-0@lo:400:kworker.0 Request processed in 36us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947491.073371:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1783947491.073607:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236089728:0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.073620:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236090240:0@lo:400:kworker.0 00000100:00100000:3.0:1783947491.078738:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947491.078874:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236090496:0@lo:400:kworker.0 00000100:00100000:3.0:1783947491.078909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947491.078951:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236091008:0@lo:400:kworker.0 00000100:00100000:3.0:1783947491.078973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947491.079942:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236089984 00000100:00100000:1.0:1783947491.079951:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236089984 00000100:00100000:1.0:1783947491.080014:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783947491.080025:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236089984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947491.080095:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236089984:12345-0@lo:400:kworker.0 Request processed in 72us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947491.080115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783947491.082569:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236089984:0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.086960:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236090496 00000100:00100000:0.0:1783947491.086977:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236090496 00000100:00100000:0.0:1783947491.087118:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091008 00000100:00100000:0.0:1783947491.087123:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091008 00000100:00100000:3.0:1783947491.087187:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783947491.087200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236090496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947491.087318:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236090496:12345-0@lo:400:kworker.0 Request processed in 121us (8406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947491.087326:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00080000:3.0:1783947491.087380:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc9428700 x1870604236090496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947491.087395:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236090496:0@lo:400:kworker.0 00000100:00080000:1.0:1783947491.095794:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947491.096882:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783947491.096899:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236091008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.097022:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236091008:12345-0@lo:400:kworker.0 Request processed in 129us (18047us total) trans 0 rc 0/0 00010000:00080000:3.0:1783947491.097155:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc9429500 x1870604236091008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947491.097170:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236091008:0@lo:400:kworker.0 00000100:00100000:0.0:1783947491.102351:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00010000:1.0:1783947491.507751:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947491.572691:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236091264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947491.572791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947491.572931:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091264 00000100:00100000:2.0:1783947491.572941:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091264 00000100:00100000:2.0:1783947491.573001:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783947491.573010:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236091264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783947491.573070:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947491.573145:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236091264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947491.573157:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1783947491.573234:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc942b480 x1870604236091264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947491.573258:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236091264:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1783947492.492953:0:14055:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:58:09 (1783947489) 00010000:00010000:3.0:1783947492.531632:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947493.107814:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236091392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947493.107899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947493.108109:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091392 00000100:00100000:0.0:1783947493.108118:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091392 00000100:00100000:0.0:1783947493.108169:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783947493.108179:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236091392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947493.108215:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783947493.108266:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236091392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947493.108274:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783947493.108404:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236091392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783947493.555780:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947494.318624:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947494.319620:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213976064 00000100:00100000:2.0:1783947494.319633:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213976064 00000100:00100000:2.0:1783947494.319718:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:2.0:1783947494.319730:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:11082:x1870604213976064:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947494.319753:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947494.319823:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e77 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.319913:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550043a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.319927:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550043a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.319940:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550043a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947494.319992:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947494.320011:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947494.320053:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550043a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.320079:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e77 expref: 7 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.320100:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550043a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e77 expref: 6 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.320108:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcba0300) 00010000:00010000:2.0:1783947494.320111:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947494.320115:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947494.320196:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+6:11082:x1870604213976064:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 469us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947494.320203:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00080000:1.0:1783947494.321338:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947494.341777:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947494.341908:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213976192 00000100:00100000:2.0:1783947494.341920:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213976192 00000100:00100000:2.0:1783947494.341988:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:2.0:1783947494.341998:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+6:11083:x1870604213976192:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947494.342019:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947494.342042:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e7e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342119:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342133:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342174:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342191:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342198:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342203:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342495:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55500456 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342506:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55500456 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342513:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55500456 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947494.342570:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947494.342574:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947494.342595:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55500456 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342606:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342612:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342629:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342635:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947494.342639:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342647:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342657:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcba0300) 00010000:00010000:2.0:1783947494.342660:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947494.342664:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342670:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342682:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342687:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342693:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342698:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947494.342701:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342718:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342726:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e7bfcba0600) 00010000:00010000:2.0:1783947494.342728:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947494.342731:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342737:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550044f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342769:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e7e expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342783:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55500456 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e7e expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947494.342790:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7bfcba0500) 00010000:00010000:2.0:1783947494.342792:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947494.342794:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e800, rc 0) 00000100:00100000:2.0:1783947494.343032:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+7:11083:x1870604213976192:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1034us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947494.343040:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1783947494.367261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947494.367346:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213976320 00000100:00100000:2.0:1783947494.367356:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213976320 00000100:00100000:2.0:1783947494.367420:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947494.367431:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1eb923ac-790a-478f-897e-124614dbce09+7:11083:x1870604213976320:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783947494.367598:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1eb923ac-790a-478f-897e-124614dbce09+7:11083:x1870604213976320:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 Request processed in 168us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947494.367606:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1783947494.409698:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947494.410370:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213976576 00000100:00100000:1.0:1783947494.410381:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213976576 00000100:00100000:1.0:1783947494.410487:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:1.0:1783947494.410499:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+7:11083:x1870604213976576:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947494.410522:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947494.410559:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550045d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.410635:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.410649:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.410660:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429354:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429380:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429394:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429568:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55500472 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429578:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55500472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429584:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55500472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947494.429596:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783947494.429703:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429711:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429717:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429722:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947494.429726:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429733:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429746:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7bfcba0500) 00010000:00010000:1.0:1783947494.429749:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947494.429753:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429768:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500464 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429782:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429788:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429793:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429798:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947494.429802:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429808:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429815:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e7bd001ba00) 00010000:00010000:1.0:1783947494.429818:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947494.429821:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.429827:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550046b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.430121:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb5550045d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e85 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.430136:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55500472 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e85 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947494.430149:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:1.0:1783947494.430152:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947494.430154:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438c00, rc 0) 00000100:00100000:1.0:1783947494.430243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+9:11083:x1870604213976576:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 19746us (20554us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783947494.430252:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:1.0:1783947494.435957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947494.436316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213976704 00000100:00100000:3.0:1783947494.436327:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213976704 00000100:00100000:3.0:1783947494.436410:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:3.0:1783947494.436421:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+9:11083:x1870604213976704:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783947494.436563:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+9:11083:x1870604213976704:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 144us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947494.436583:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:0.0:1783947494.453234:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947494.453361:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213976832 00000100:00100000:3.0:1783947494.453372:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213976832 00000100:00100000:3.0:1783947494.453450:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00080000:1.0:1783947494.453485:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947494.453493:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:11083:x1870604213976832:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1783947494.467931:0:12193:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 14390us 00000100:00100000:0.0:1783947494.511049:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:11083:x1870604213976832:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 57548us (57813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947494.511065:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00010000:00010000:0.0:1783947494.580422:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947494.645293:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947494.645320:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236091520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947494.645395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947494.645490:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091520 00000100:00100000:3.0:1783947494.645498:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091520 00000100:00080000:2.0:1783947494.645756:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947494.645912:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783947494.645925:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236091520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947494.645959:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947494.646019:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236091520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947494.646090:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236091520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947494.646853:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947494.646865:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236091648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947494.646902:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947494.646942:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091648 00000100:00100000:0.0:1783947494.646947:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091648 00000100:00080000:1.0:1783947494.647014:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947494.647771:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783947494.649027:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783947494.649062:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236091648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947494.649092:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947494.649180:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236091648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947494.649187:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783947494.649402:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236091648:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1783947494.775495:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783947494.778063:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947494.897503:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947494.897546:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947494.897588:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947494.897630:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213977088 00000100:00100000:1.0:1783947494.897640:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213977088 00000100:00100000:1.0:1783947494.897699:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213977216 00000100:00100000:1.0:1783947494.897703:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213977216 00000100:00100000:1.0:1783947494.897726:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 271 00000100:00100000:1.0:1783947494.897736:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213977088:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947494.897808:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213977088:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 74us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947494.897816:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 271 00000100:00100000:1.0:1783947494.897833:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 272 00000100:00100000:1.0:1783947494.897853:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213977216:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947494.897880:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604213977216:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947494.897898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 272 00000100:00080000:1.0:1783947494.897917:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947494.897921:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947494.899917:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213976960 00000100:00100000:2.0:1783947494.899931:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213976960 00000100:00100000:2.0:1783947494.900008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 376 00000100:00100000:2.0:1783947494.900019:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213976960:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947494.900099:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604213976960:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 83us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947494.900107:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 376 00000100:00100000:2.0:1783947495.166682:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236091776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947495.166772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947495.166888:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091776 00000100:00100000:0.0:1783947495.166898:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091776 00000100:00100000:0.0:1783947495.166962:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783947495.166974:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236091776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947495.167037:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783947495.167101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236091776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947495.167109:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783947495.167152:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236091776:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947495.603679:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947496.179707:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947496.179733:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236091904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947496.179809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.179887:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236091904 00000100:00100000:1.0:1783947496.179909:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236091904 00000100:00100000:1.0:1783947496.179962:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783947496.179972:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236091904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947496.180002:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947496.180047:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236091904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.180054:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1783947496.180076:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947496.180106:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac640aa00 x1870604236091904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947496.180123:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236091904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947496.186329:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236092416:0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947496.186499:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236092928:0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186548:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947496.186569:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236093440:0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947496.186620:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783947496.186625:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236092288:0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186650:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947496.186664:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236092800:0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186683:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947496.186695:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236093312:0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947496.186747:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092416 00000100:00100000:0.0:1783947496.186754:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092416 00000100:00100000:0.0:1783947496.186803:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092800 00000100:00100000:0.0:1783947496.186806:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092800 00000100:00100000:0.0:1783947496.186843:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236093312 00000100:00100000:0.0:1783947496.186847:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236093312 00000100:00100000:0.0:1783947496.186863:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1783947496.186870:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236092416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186933:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236092416:12345-0@lo:400:kworker.0 Request processed in 63us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947496.186941:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1783947496.186960:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783947496.186967:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236092800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.186995:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236092800:12345-0@lo:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947496.187001:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783947496.187013:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1783947496.187019:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236093312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.187043:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236093312:12345-0@lo:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947496.187049:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00080000:0.0:1783947496.187094:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7df80 x1870604236092800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947496.187108:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236092800:0@lo:400:kworker.0 00010000:00080000:0.0:1783947496.187118:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7f100 x1870604236093312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947496.187125:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236093312:0@lo:400:kworker.0 00000100:00100000:0.0:1783947496.187133:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236092416:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.187897:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236092032:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.187958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.188003:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236092544:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188028:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.188053:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236093056:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.188100:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783947496.188116:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236092160:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188152:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.188170:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236092672:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.188206:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236093184:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.188258:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092928 00000100:00100000:1.0:1783947496.188264:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092928 00000100:00100000:1.0:1783947496.188325:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236093440 00000100:00100000:1.0:1783947496.188328:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236093440 00000100:00100000:1.0:1783947496.188351:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236093056 00000100:00100000:1.0:1783947496.188353:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236093056 00000100:00100000:1.0:1783947496.188370:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947496.188376:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236092928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188424:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236092928:12345-0@lo:400:kworker.0 Request processed in 47us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.188431:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783947496.188450:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783947496.188492:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236093440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188524:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236093440:12345-0@lo:400:kworker.0 Request processed in 69us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.188530:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783947496.188542:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783947496.188548:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236093056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.188578:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236093056:12345-0@lo:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.188582:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783947496.188614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092288 00000100:00100000:1.0:1783947496.188617:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092288 00000100:00100000:1.0:1783947496.189205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092544 00000100:00100000:1.0:1783947496.189212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092544 00000100:00100000:1.0:1783947496.189234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783947496.189240:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236092288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.189286:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236092288:12345-0@lo:400:kworker.0 Request processed in 47us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947496.189413:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092032 00000100:00100000:3.0:1783947496.189418:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092032 00000100:00100000:3.0:1783947496.189448:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1783947496.189468:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236092032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947496.189504:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236092032:12345-0@lo:400:kworker.0 Request processed in 51us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947496.189510:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1783947496.189633:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783947496.189648:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783947496.189654:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236092544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.189685:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236092544:12345-0@lo:400:kworker.0 Request processed in 32us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.189691:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783947496.189710:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092160 00000100:00100000:1.0:1783947496.189713:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092160 00000100:00100000:1.0:1783947496.189747:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236092672 00000100:00100000:1.0:1783947496.189750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236092672 00000100:00100000:1.0:1783947496.189763:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236093184 00000100:00100000:1.0:1783947496.189766:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236093184 00000100:00100000:1.0:1783947496.189777:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783947496.189782:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236092160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.189812:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236092160:12345-0@lo:400:kworker.0 Request processed in 29us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.189826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783947496.189836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1783947496.189841:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236092672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.189865:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236092672:12345-0@lo:400:kworker.0 Request processed in 24us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.189880:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1783947496.189890:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1783947496.189894:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236093184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.189920:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236093184:12345-0@lo:400:kworker.0 Request processed in 26us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.189925:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1783947496.189967:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947496.189972:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947496.189975:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947496.189977:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947496.190022:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236092160:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.190033:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236092672:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.190043:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236093184:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.190051:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236092032:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.190060:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236092544:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.190070:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236093056:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.190112:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236092288:0@lo:400:kworker.0 00000100:00100000:1.0:1783947496.190123:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236092928:0@lo:400:kworker.0 00010000:00080000:1.0:1783947496.190150:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7c380 x1870604236093440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947496.190160:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236093440:0@lo:400:kworker.0 00010000:00010000:0.0:1783947496.628945:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947496.691679:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947496.691702:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236093568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947496.691771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947496.691871:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236093568 00000100:00100000:1.0:1783947496.691896:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236093568 00000100:00100000:1.0:1783947496.691957:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783947496.691967:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236093568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947496.691992:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947496.692044:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236093568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947496.692051:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1783947496.692089:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc9428a80 x1870604236093568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947496.692106:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236093568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947497.028397:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.031147:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213977344 00000100:00100000:0.0:1783947497.031161:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213977344 00000100:00100000:0.0:1783947497.032058:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:0.0:1783947497.032078:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+9:11126:x1870604213977344:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947497.032107:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.032130:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500480 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e8c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032207:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032222:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032234:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032249:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032256:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032262:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032306:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032313:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032320:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032488:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.032493:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032500:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032512:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcba0300) 00010000:00010000:0.0:1783947497.032515:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.032519:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032525:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032537:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032543:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032548:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032553:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.032556:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032561:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032580:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e7bffb76400) 00010000:00010000:0.0:1783947497.032583:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.032586:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032593:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb5550048e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032626:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500480 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e8c expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032636:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcba0300) 00010000:00010000:0.0:1783947497.032638:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.032642:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500480 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e8c expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.032651:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:0.0:1783947497.032721:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+9:11126:x1870604213977344:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 646us (4334us total) trans 0 rc 301/301 00000100:00100000:0.0:1783947497.032729:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00080000:1.0:1783947497.038038:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947497.043433:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947497.043607:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213977600 00000100:00100000:2.0:1783947497.043618:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213977600 00000100:00100000:2.0:1783947497.043680:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:2.0:1783947497.043691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+9:11126:x1870604213977600:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:2.0:1783947497.043758:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947497.043786:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb5550043a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e77 expref: 9 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.043814:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcba0300) 00010000:00010000:2.0:1783947497.043824:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947497.043893:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.043906:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.043915:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.043927:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.043935:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.043942:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044498:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044510:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044531:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947497.044548:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a9e9072 reply state 00000000621896cd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044558:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044565:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:2.0:1783947497.044567:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947497.044571:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783947497.044576:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783947497.044584:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044589:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044595:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044600:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947497.044604:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044610:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044617:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc5593400) 00010000:00010000:2.0:1783947497.044619:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947497.044629:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044635:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500495 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947497.044648:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a9e9072 reply state 00000000621896cd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044658:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.044664:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e7bc5593e00) 00010000:00010000:2.0:1783947497.044666:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947497.044668:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1783947497.044761:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+10:11126:x1870604213977600:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 1071us (1337us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783947497.044769:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:3.0:1783947497.119846:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.120064:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213977728 00000100:00100000:0.0:1783947497.120078:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213977728 00000100:00100000:0.0:1783947497.120185:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:0.0:1783947497.120199:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+10:11134:x1870604213977728:12345-192.168.204.3@tcp:101:lctl.0 00010000:00010000:0.0:1783947497.120231:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.120260:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555004aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e93 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.120665:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555004b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.120685:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555004b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.120701:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555004b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947497.120848:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947497.120853:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947497.120900:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555004b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.120999:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555004aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e93 expref: 12 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.121024:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555004b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e93 expref: 11 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.121034:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:0.0:1783947497.121038:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947497.121041:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ba00, rc 0) 00000100:00100000:0.0:1783947497.121130:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+11:11134:x1870604213977728:12345-192.168.204.3@tcp:101:lctl.0 Request processed in 934us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.121140:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:1.0:1783947497.179318:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.179619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213977856 00000100:00100000:0.0:1783947497.179633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213977856 00000100:00100000:0.0:1783947497.179731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:0.0:1783947497.179744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+11:11140:x1870604213977856:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947497.179778:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.179820:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555004b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3e9a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.179931:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.179950:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.179965:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.179978:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.179986:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.179993:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180107:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555004cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180115:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555004cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180120:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555004cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947497.180180:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783947497.180185:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947497.180231:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555004cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180247:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180254:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180261:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180268:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.180273:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180292:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180309:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:0.0:1783947497.180312:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.180318:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180325:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb555004bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180343:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180360:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180367:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180372:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.180376:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180383:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180391:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e7bc5593e00) 00010000:00010000:0.0:1783947497.180394:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.180397:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180404:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555004c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180760:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555004b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e9a expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180780:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555004cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e9a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.180788:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947497.180792:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783947497.180811:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9be00, rc 0) 00000100:00100000:0.0:1783947497.180910:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+12:11140:x1870604213977856:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1167us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.180928:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:1.0:1783947497.187822:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.187938:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213978112 00000100:00100000:0.0:1783947497.187953:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213978112 00000100:00100000:0.0:1783947497.188078:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:0.0:1783947497.188091:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+12:11140:x1870604213978112:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947497.188123:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.188154:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555004d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ea1 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.188326:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.188347:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.188361:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.188757:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.188789:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.188816:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947497.189261:0:12193:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1783947497.189556:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189568:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189576:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189614:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189622:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189629:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189635:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.189640:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189647:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189662:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947497.189664:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.189668:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189674:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555004db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947497.189701:0:12193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004228a569 reply state 00000000cd19653f transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189713:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189719:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:0.0:1783947497.189721:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947497.189725:0:12193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783947497.189767:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555004d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 15 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189784:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 14 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.189791:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76500) 00010000:00010000:0.0:1783947497.189794:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947497.189807:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96400, rc 0) 00000100:00100000:0.0:1783947497.189894:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+15:11140:x1870604213978112:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1806us (2099us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783947497.189903:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:2.0:1783947497.195213:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947497.195697:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213978240 00000100:00100000:1.0:1783947497.195712:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213978240 00000100:00100000:1.0:1783947497.195831:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:1.0:1783947497.195842:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2405:x1870604213978240:12345-192.168.204.3@tcp:8:bash.0 00010000:00080000:1.0:1783947497.195893:0:8429:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:1.0:1783947497.195956:0:8429:0:(genops.c:1406:class_connect()) connect: client 1eb923ac-790a-478f-897e-124614dbce09, cookie 0xe6fd1fdb555004f7 00002000:00100000:1.0:1783947497.195974:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1eb923ac-790a-478f-897e-124614dbce09/ffff9e7ac7cc5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783947497.195991:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783947497.196103:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783947497.196147:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7cc3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947497.196671:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2405:x1870604213978240:12345-192.168.204.3@tcp:8:bash.0 Request processed in 825us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.196703:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:1.0:1783947497.199044:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947497.202182:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213978368 00000100:00100000:2.0:1783947497.202204:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213978368 00000100:00100000:2.0:1783947497.202717:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1783947497.202731:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+6:0:x1870604213978368:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947497.202757:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947497.202788:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ea8 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947497.202838:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947497.202864:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1783947497.202870:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947497.202897:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 7 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.202922:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 7 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.202941:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947497.203039:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:0:x1870604213978368:12345-192.168.204.3@tcp:101:bash.0 Request processed in 312us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947497.203047:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00080000:1.0:1783947497.204737:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947497.209983:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947497.210743:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213978496 00000100:00100000:1.0:1783947497.210762:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213978496 00000100:00100000:1.0:1783947497.210870:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1783947497.210884:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+7:11140:x1870604213978496:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947497.210913:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947497.210944:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3eaf expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.210987:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.210998:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947497.211004:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947497.211011:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.211058:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.211075:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 8 pid: 8539 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947497.211094:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870604236093696:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947497.211272:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c12840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947497.214768:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947497.215031:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8427:1870604236093696:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947497.215086:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.215116:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439e00, rc 0) 00000100:00100000:1.0:1783947497.215198:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+8:11140:x1870604213978496:12345-192.168.204.3@tcp:101:bash.0 Request processed in 4317us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.215210:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:2.0:1783947497.217240:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213978624 00000100:00100000:2.0:1783947497.217262:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213978624 00010000:00010000:2.0:1783947497.217563:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 8 pid: 8539 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947497.217677:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:2.0:1783947497.217689:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc6499050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604213978624:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947497.217711:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947497.217743:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 8 pid: 8539 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.217759:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 8 pid: 8539 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.217803:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c120409b/0xe6fd1fdb555004fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea8 expref: 8 pid: 8539 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.217853:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947497.217859:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947497.217870:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.217882:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.218034:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947497.218054:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1870604236093824:192.168.204.3@tcp:105: 00000100:00100000:2.0:1783947497.218242:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1783947497.222942:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1870604236093824:192.168.204.3@tcp:105: 00010000:00010000:1.0:1783947497.222981:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947497.223044:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc6499050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604213978624:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 5356us (8291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.223056:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:3.0:1783947497.225756:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.225874:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213978880 00000100:00100000:0.0:1783947497.225889:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213978880 00000100:00100000:0.0:1783947497.226043:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1783947497.226057:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+15:11140:x1870604213978880:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:0.0:1783947497.226727:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+16:11140:x1870604213978880:12345-192.168.204.3@tcp:35:bash.0 Request processed in 668us (981us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783947497.226760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1783947497.343033:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947497.343250:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213979136 00000100:00100000:3.0:1783947497.343264:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213979136 00000100:00100000:3.0:1783947497.343355:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:3.0:1783947497.343387:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+16:11150:x1870604213979136:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947497.343424:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947497.343453:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb5550050c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3eb6 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947497.343658:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783947497.343814:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb5550050c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eb6 expref: 18 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947497.343833:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:3.0:1783947497.343838:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947497.343844:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb5550050c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eb6 expref: 18 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947497.343865:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50a00, rc 0) 00000100:00100000:3.0:1783947497.343952:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+17:11150:x1870604213979136:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 568us (935us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1783947497.343962:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:2.0:1783947497.346932:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.347095:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213979392 00000100:00100000:0.0:1783947497.347221:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213979392 00000100:00100000:0.0:1783947497.347300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1783947497.347312:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+17:11150:x1870604213979392:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947497.347659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+18:11150:x1870604213979392:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 347us (741us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783947497.347668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:1.0:1783947497.413260:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.413573:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213979520 00000100:00100000:0.0:1783947497.413589:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213979520 00000100:00100000:0.0:1783947497.413753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1783947497.413766:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:11156:x1870604213979520:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947497.413812:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.413846:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550051a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ebd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.413951:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500521 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.413971:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.413984:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947497.414041:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783947497.414064:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947497.414102:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500521 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.414136:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550051a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ebd expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.414161:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500521 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ebd expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.414172:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947497.414176:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947497.414180:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:0.0:1783947497.414275:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:11156:x1870604213979520:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 511us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.414283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:2.0:1783947497.418677:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.419035:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213979776 00000100:00100000:0.0:1783947497.419051:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213979776 00000100:00100000:0.0:1783947497.419139:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1783947497.419152:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+19:11156:x1870604213979776:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947497.419184:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.419231:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500528 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ec4 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.419378:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550052f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.419396:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550052f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.419450:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550052f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947497.419491:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783947497.419640:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500528 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ec4 expref: 22 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.419664:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550052f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ec4 expref: 21 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.419674:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76500) 00010000:00010000:0.0:1783947497.419677:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947497.419681:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9aa00, rc 0) 00000100:00100000:0.0:1783947497.419885:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+21:11156:x1870604213979776:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 735us (1222us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1783947497.419894:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:3.0:1783947497.424123:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947497.424181:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947497.426073:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213980032 00000100:00100000:2.0:1783947497.426091:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213980032 00000100:00100000:2.0:1783947497.426452:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:2.0:1783947497.426495:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+21:11156:x1870604213980032:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947497.426533:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947497.426561:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550053d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ecb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.426714:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500544 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.426759:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500544 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.426775:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500544 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947497.426804:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783947497.427117:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550053d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ecb expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.427141:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500544 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ecb expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.427151:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76500) 00010000:00010000:2.0:1783947497.427155:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783947497.427159:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f800, rc 0) 00000100:00100000:2.0:1783947497.427274:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+23:11156:x1870604213980032:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 783us (3166us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1783947497.427283:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:1.0:1783947497.431875:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213980160 00000100:00100000:1.0:1783947497.431898:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213980160 00000100:00100000:1.0:1783947497.432308:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:1.0:1783947497.432322:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+23:2406:x1870604213980160:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947497.432545:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947497.432586:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550052f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ec4 expref: 23 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.432613:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76500) 00010000:00010000:1.0:1783947497.432620:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947497.432732:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+22:2406:x1870604213980160:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 412us (8547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.432800:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:3.0:1783947497.438667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947497.442337:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213980288 00000100:00100000:1.0:1783947497.442435:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213980288 00000100:00100000:1.0:1783947497.442669:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1783947497.442681:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604213980288:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:1.0:1783947497.442761:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.442788:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.442809:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947497.442813:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947497.442818:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.442867:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.442883:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 7 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947497.442901:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1870604236093952:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947497.443046:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c12300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947497.448580:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1870604236093952:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947497.448653:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947497.450019:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947497.450212:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213980416 00000100:00100000:2.0:1783947497.450225:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213980416 00002000:00100000:2.0:1783947497.450878:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9e7ac7c90700 x1870604213980416/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:288/0 lens 504/0 e 0 to 0 dl 1783947508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947497.450893:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7c90700 with x1870604213980416 ext(0->12) 00010000:00010000:2.0:1783947497.450907:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 8 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.451179:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 8 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947497.451189:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7ac7c90700 00000100:00100000:2.0:1783947497.451304:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:2.0:1783947497.451320:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604213980416:12345-192.168.204.3@tcp:4:lfs.0 00000001:00100000:2.0:1783947497.478521:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000100:00100000:1.0:1783947497.481004:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+9:2407:x1870604213980416:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 29676us (31255us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783947497.481025:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00002000:00100000:1.0:1783947497.481041:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9e7ac7c90700 x1870604213980416/t4294967300(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:288/0 lens 504/448 e 0 to 0 dl 1783947508 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947497.481051:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7c90700 with x1870604213980416 ext(0->12) 00010000:00010000:1.0:1783947497.481061:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 9 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.481083:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 9 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947497.481091:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7ac7c90700 00000100:00100000:3.0:1783947497.494326:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947497.494872:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213980544 00000100:00100000:2.0:1783947497.494887:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213980544 00010000:00010000:2.0:1783947497.494968:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 9 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947497.495033:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:2.0:1783947497.495045:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604213980544:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947497.495072:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783947497.495097:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783947497.495100:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783947496 00002000:00010000:2.0:1783947497.495103:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783947496 00002000:00010000:2.0:1783947497.495105:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783947496 00002000:00010000:2.0:1783947497.495107:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783947497.495115:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 9 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.495132:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 9 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.495184:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093aa3a92/0xe6fd1fdb55500505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eaf expref: 9 pid: 8427 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.495211:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947497.495218:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947497.495225:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.495237:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.495287:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947497.495504:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495527:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495562:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495575:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495605:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495623:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947497.495632:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495643:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495668:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.495676:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062815532/0xe6fd1fdb55500552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947497.495801:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604213980288:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 53107us (57347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.495812:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1783947497.496007:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604213980544:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 958us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947497.496018:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:0.0:1783947497.501146:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947497.501728:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213980800 00000100:00100000:3.0:1783947497.501742:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213980800 00000100:00100000:1.0:1783947497.501989:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:3.0:1783947497.502000:0:6514:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1783947497.502016:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+22:11156:x1870604213980800:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1783947497.502018:0:6514:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:1.0:1783947497.502115:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500544 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ecb expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947497.502428:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1783947497.502510:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1783947497.502885:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1783947497.502931:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.502951:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 26 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.502960:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.503003:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 26 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.503021:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 26 pid: 12193 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947497.503036:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1870604236094080:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947497.503146:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c12300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947497.506894:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.507115:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213980928 00000100:00100000:0.0:1783947497.507129:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213980928 00010000:00010000:0.0:1783947497.507186:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 27 pid: 12193 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947497.507252:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:0.0:1783947497.507264:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+27:2406:x1870604213980928:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947497.507286:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947497.507296:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 27 pid: 12193 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.507322:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 27 pid: 12193 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.507366:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76500) 00010000:00010000:0.0:1783947497.507373:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.507385:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.507392:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.507417:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947497.507529:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+27:2406:x1870604213980928:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 267us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.507538:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00010000:00010000:1.0:1783947497.508070:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555004e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ea1 expref: 26 pid: 12193 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947497.508099:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1870604236094080:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947497.508131:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.508156:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.508163:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947497.508320:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1783947497.508664:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1783947497.508838:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236094208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947497.508914:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947497.508950:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c12180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947497.508985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236094208 00000100:00100000:1.0:1783947497.508992:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236094208 00000100:00100000:1.0:1783947497.509046:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783947497.509057:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1870604236094208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947497.509156:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1870604236094208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.509164:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783947497.509208:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236094208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783947497.511568:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1783947497.511688:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236094336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947497.511764:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947497.511812:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947497.512177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236094336 00000100:00100000:0.0:1783947497.512187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236094336 00000100:00100000:0.0:1783947497.512243:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783947497.512256:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1870604236094336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783947497.512744:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1870604236094336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 489us (978us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783947497.512753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783947497.513196:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236094336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783947497.513272:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1783947497.513606:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.513619:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.513628:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.513634:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947497.513650:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.513660:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.513678:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76500) 00010000:00010000:2.0:1783947497.513681:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783947497.513686:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947497.513693:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500559 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947497.513831:0:6513:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783947497.513911:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783947497.514775:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382742316437ns, next at 383742311807ns, rc = 0 00000001:00080000:2.0:1783947497.514803:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1783947497.514854:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76500) 00010000:00010000:2.0:1783947497.514859:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783947497.514870:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500544 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ecb expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947497.515265:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+29:11156:x1870604213980800:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 13259us (14191us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1783947497.515286:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000020:00080000:2.0:1783947497.515293:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783947497.519238:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.519634:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213981056 00000100:00100000:0.0:1783947497.519648:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213981056 00000100:00100000:0.0:1783947497.519733:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:0.0:1783947497.519744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+29:11156:x1870604213981056:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947497.519810:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.519846:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500560 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ed2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.519927:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500560 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ed2 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.519946:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500560 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ed2 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.519970:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947497.519974:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947497.519978:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:0.0:1783947497.520163:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+30:11156:x1870604213981056:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 419us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.520172:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:2.0:1783947497.525386:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947497.525774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213981312 00000100:00100000:3.0:1783947497.525797:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213981312 00000100:00100000:3.0:1783947497.525872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:3.0:1783947497.525885:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+30:11156:x1870604213981312:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1783947497.527197:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+31:11156:x1870604213981312:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 458us (969us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1783947497.527212:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1783947497.626002:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947497.627741:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213981568 00000100:00100000:3.0:1783947497.627772:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213981568 00000100:00100000:3.0:1783947497.627906:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:3.0:1783947497.627934:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+31:11166:x1870604213981568:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947497.627991:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947497.628040:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ed9 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947497.628225:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783947497.630423:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500567 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ed9 expref: 33 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947497.630572:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:3.0:1783947497.630659:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947497.630697:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ed9 expref: 33 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947497.631168:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50a00, rc 0) 00000100:00100000:3.0:1783947497.631433:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+32:11166:x1870604213981568:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 3511us (5455us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1783947497.631533:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:2.0:1783947497.643333:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947497.643667:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213981696 00000100:00100000:1.0:1783947497.643682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213981696 00000100:00100000:1.0:1783947497.643770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:1.0:1783947497.643783:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+32:11166:x1870604213981696:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1783947497.643914:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644053:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644133:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644151:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644159:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644166:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644398:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644410:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.644417:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947497.645172:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645195:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645218:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645226:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645234:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947497.645239:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645248:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645264:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947497.645268:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947497.645407:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645415:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500575 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645432:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645438:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645445:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645451:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947497.645663:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645671:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645680:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:1.0:1783947497.645683:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947497.645687:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645692:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb5550057c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645706:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645712:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645718:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645723:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947497.645726:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645731:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645738:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947497.645740:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947497.645751:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947497.645757:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55500583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947497.645904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+32:11166:x1870604213981696:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 2115us (2578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947497.645916:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00010000:00010000:2.0:1783947497.652139:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947497.658920:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947497.660751:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213981952 00000100:00100000:1.0:1783947497.660772:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213981952 00000100:00100000:1.0:1783947497.660929:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:1.0:1783947497.660944:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+32:11166:x1870604213981952:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947497.661507:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+33:11166:x1870604213981952:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 563us (2608us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1783947497.661517:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1783947497.725609:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.725698:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213982208 00000100:00100000:0.0:1783947497.725713:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213982208 00000100:00100000:0.0:1783947497.725809:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:0.0:1783947497.725824:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+33:11169:x1870604213982208:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947497.725863:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947497.725894:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550058a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ee0 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726053:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726074:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726099:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726114:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726122:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726129:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726273:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726296:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726303:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947497.726317:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783947497.726428:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726437:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726445:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726452:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9bc00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.726493:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726503:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726519:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947497.726522:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.726528:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726536:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500591 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726553:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726560:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726566:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726572:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.726575:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726581:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726588:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:0.0:1783947497.726591:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947497.726600:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726606:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500598 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726654:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550058a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 36 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726669:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 35 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.726676:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947497.726679:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947497.726681:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:0.0:1783947497.726773:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+35:11169:x1870604213982208:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 953us (1181us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783947497.726782:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:3.0:1783947497.734981:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.735350:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213982336 00000100:00100000:0.0:1783947497.735365:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213982336 00000100:00100000:0.0:1783947497.736500:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:0.0:1783947497.736524:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+35:11169:x1870604213982336:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:0.0:1783947497.736649:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736674:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736690:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736767:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736775:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736782:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736801:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947497.736806:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736815:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736831:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947497.736835:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947497.736840:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947497.736847:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947497.736971:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+35:11169:x1870604213982336:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 458us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947497.736981:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:3.0:1783947497.746277:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947497.746592:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213982592 00000100:00100000:0.0:1783947497.746608:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213982592 00000100:00100000:0.0:1783947497.746674:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1783947497.746706:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+35:11169:x1870604213982592:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947497.747118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+36:11169:x1870604213982592:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 413us (854us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783947497.747127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000040:00080000:3.0:1783947497.844536:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783947497.844633:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783947498.013226:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947498.014528:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213982848 00000100:00100000:1.0:1783947498.014548:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213982848 00000100:00100000:1.0:1783947498.014791:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:1.0:1783947498.014804:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+36:11200:x1870604213982848:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:1.0:1783947498.014839:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947498.014875:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb555005b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ee7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.015813:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555005bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.015838:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555005bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.015992:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555005bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947498.016008:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783947498.016208:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb555005b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee7 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.016231:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555005bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee7 expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.016242:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947498.016245:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947498.016250:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438e00, rc 0) 00000100:00100000:1.0:1783947498.016353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+38:11200:x1870604213982848:12345-192.168.204.3@tcp:101:cat.0 Request processed in 1551us (3140us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783947498.016362:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:3.0:1783947498.023572:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947498.023832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213983104 00000100:00100000:1.0:1783947498.023849:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213983104 00000100:00100000:1.0:1783947498.024146:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:1.0:1783947498.024159:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+38:11200:x1870604213983104:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:1.0:1783947498.024524:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+39:11200:x1870604213983104:12345-192.168.204.3@tcp:35:cat.0 Request processed in 367us (967us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1783947498.024532:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1783947498.026170:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947498.026652:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213983232 00000100:00100000:1.0:1783947498.026665:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213983232 00000100:00100000:1.0:1783947498.026751:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:1.0:1783947498.026762:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+39:2407:x1870604213983232:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947498.026808:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947498.026841:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555005bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee7 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.026867:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947498.026872:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947498.026949:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+38:2407:x1870604213983232:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 189us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947498.026957:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:2.0:1783947498.086030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947498.086424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213983488 00000100:00100000:3.0:1783947498.086438:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213983488 00000100:00100000:3.0:1783947498.086696:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:3.0:1783947498.086711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+38:11206:x1870604213983488:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:3.0:1783947498.086757:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947498.086761:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947498.086809:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500521 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ebd expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.086834:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947498.086840:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947498.086858:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb555005c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3eee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.087122:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.087139:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 38 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.087148:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.087204:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 38 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.087219:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 38 pid: 12193 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947498.087236:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236094464:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947498.087432:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947498.091881:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236094464:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947498.091937:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947498.093135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947498.093368:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213983616 00000100:00100000:0.0:1783947498.093380:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213983616 00010000:00010000:0.0:1783947498.093448:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 39 pid: 12193 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947498.093682:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:0.0:1783947498.093694:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+39:2407:x1870604213983616:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947498.093715:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947498.093724:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 39 pid: 12193 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.094017:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 39 pid: 12193 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.094055:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550059f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ee0 expref: 39 pid: 12193 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.094076:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947498.094081:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.094093:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.094121:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.094157:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947498.094232:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+38:2407:x1870604213983616:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 540us (1105us total) trans 0 rc 0/0 00010000:00010000:2.0:1783947498.094251:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.094259:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947498.094296:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783947498.094548:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb555005c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 40 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.094567:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.094574:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947498.094577:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783947498.094802:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50200, rc 0) 00000100:00100000:2.0:1783947498.094841:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+39:11206:x1870604213983488:12345-192.168.204.3@tcp:101:dd.0 Request processed in 8134us (8827us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783947498.094862:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1783947498.095165:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:3.0:1783947498.098448:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947498.098521:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213983744 00000100:00100000:0.0:1783947498.098533:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213983744 00000100:00100000:0.0:1783947498.098615:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1783947498.098627:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+38:11206:x1870604213983744:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:0.0:1783947498.098676:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947498.098714:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ef5 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.098785:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.098806:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.098824:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.099298:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555005de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 40 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.099325:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 39 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.099343:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947498.099347:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947498.099352:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9aa00, rc 0) 00000100:00100000:0.0:1783947498.099439:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+39:11206:x1870604213983744:12345-192.168.204.3@tcp:101:dd.0 Request processed in 814us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947498.099448:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:2.0:1783947498.106063:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947498.106297:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213984000 00000100:00100000:0.0:1783947498.106312:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213984000 00000100:00100000:0.0:1783947498.106396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:0.0:1783947498.106409:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+39:11206:x1870604213984000:12345-192.168.204.3@tcp:36:dd.0 00010000:00010000:0.0:1783947498.106744:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.106767:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.106792:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947498.106846:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1783947498.106872:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096d9ebb9 reply state 0000000037c7c83d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.106887:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.106896:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947498.106899:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947498.106922:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947498.107050:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+42:11206:x1870604213984000:12345-192.168.204.3@tcp:36:dd.0 Request processed in 642us (1002us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1783947498.107060:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000020:00080000:0.0:1783947498.107067:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947498.228162:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947498.228193:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236094592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947498.228300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947498.228478:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236094592 00000100:00100000:3.0:1783947498.228489:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236094592 00000100:00100000:3.0:1783947498.228558:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783947498.228570:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236094592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947498.228618:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1783947498.228690:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236094592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947498.228697:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783947498.228847:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236094592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947498.340107:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947498.340559:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213984128 00000100:00100000:3.0:1783947498.340696:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213984128 00000100:00100000:3.0:1783947498.340793:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:3.0:1783947498.340805:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+42:11220:x1870604213984128:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:3.0:1783947498.340841:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947498.340870:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555005f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3efc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.340962:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.340998:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341012:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341027:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341035:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341041:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341136:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341148:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341156:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341201:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.341217:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 43 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947498.341244:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236094720:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947498.343141:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947498.347210:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947498.347387:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236094720:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947498.347528:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947498.347856:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213984384 00000100:00100000:0.0:1783947498.347866:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213984384 00000100:00100000:0.0:1783947498.347989:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1783947498.348001:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+44:6176:x1870604213984384:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783947498.348491:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+45:6176:x1870604213984384:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 453us (1256us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1783947498.348503:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:2.0:1783947498.356127:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947498.356516:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213984512 00000100:00100000:3.0:1783947498.356529:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213984512 00010000:00010000:3.0:1783947498.356587:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 45 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947498.356640:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:3.0:1783947498.356653:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+45:2406:x1870604213984512:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947498.356673:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947498.356682:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 45 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.356698:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 45 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.356728:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555005d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3eee expref: 45 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.356749:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:3.0:1783947498.356755:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.356767:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.356805:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.356860:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947498.356927:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+44:2406:x1870604213984512:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 277us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947498.356935:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00010000:00010000:1.0:1783947498.357019:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357029:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947498.357106:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783947498.357112:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947498.357163:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357180:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357193:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357200:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357207:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357221:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947498.357226:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357235:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357246:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947498.357249:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947498.357253:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357259:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555005fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357272:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357279:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357285:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357291:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947498.357294:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357300:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357319:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:1.0:1783947498.357322:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947498.357325:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357332:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500601 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357385:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555005f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3efc expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357404:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3efc expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.357420:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947498.357423:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947498.357425:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51200, rc 0) 00000100:00100000:1.0:1783947498.357570:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+43:11220:x1870604213984128:12345-192.168.204.3@tcp:101:stat.0 Request processed in 16766us (17479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947498.357587:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:2.0:1783947498.443563:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947498.443674:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213984768 00000100:00100000:0.0:1783947498.443698:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213984768 00000100:00100000:0.0:1783947498.443784:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:0.0:1783947498.443797:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+43:11226:x1870604213984768:12345-192.168.204.3@tcp:36:truncate.0 00010000:00010000:0.0:1783947498.443903:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947498.443948:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500608 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3efc expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.443975:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947498.443982:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947498.444837:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.444858:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.444872:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947498.444970:0:8291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1783947498.445002:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d8d739e reply state 0000000042c0269c transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.445016:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.445023:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947498.445026:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947498.445029:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947498.445282:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+45:11226:x1870604213984768:12345-192.168.204.3@tcp:36:truncate.0 Request processed in 1417us (1664us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1783947498.445292:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000020:00080000:0.0:1783947498.445299:0:8291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947498.626627:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947498.626854:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213984896 00000100:00100000:0.0:1783947498.626868:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213984896 00000100:00100000:0.0:1783947498.626948:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:0.0:1783947498.626961:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+45:11240:x1870604213984896:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:0.0:1783947498.626994:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947498.627021:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500616 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f03 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627113:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627130:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627143:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627174:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627183:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627190:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627280:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627291:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627298:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947498.627355:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783947498.627360:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947498.627389:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627405:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627414:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627434:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627452:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627521:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947498.627527:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627535:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627551:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947498.627555:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947498.627560:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627568:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550061d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627587:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627593:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627598:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627603:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947498.627606:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627623:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627632:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:0.0:1783947498.627635:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947498.627638:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627644:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500624 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627680:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500616 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627696:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947498.627704:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947498.627706:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947498.627708:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:0.0:1783947498.627803:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+46:11240:x1870604213984896:12345-192.168.204.3@tcp:101:stat.0 Request processed in 844us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947498.627812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00010000:00010000:0.0:1783947498.676234:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947498.734308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947498.734554:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213985152 00000100:00100000:1.0:1783947498.734568:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213985152 00000100:00100000:1.0:1783947498.734651:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:1.0:1783947498.734665:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+46:11250:x1870604213985152:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947498.734695:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947498.734724:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f0a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947498.734919:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783947498.735058:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500632 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f0a expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.735078:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:1.0:1783947498.735082:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947498.735088:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f0a expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.735105:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438e00, rc 0) 00000100:00100000:1.0:1783947498.735252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+47:11250:x1870604213985152:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 590us (958us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1783947498.735261:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1783947498.744388:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947498.744598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213985408 00000100:00100000:0.0:1783947498.744614:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213985408 00000100:00100000:0.0:1783947498.744691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:0.0:1783947498.744703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+47:11250:x1870604213985408:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947498.745043:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+48:11250:x1870604213985408:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 341us (668us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1783947498.745052:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:0.0:1783947498.836499:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947498.836641:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213985664 00000100:00100000:3.0:1783947498.836666:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213985664 00000100:00100000:3.0:1783947498.836748:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:3.0:1783947498.836776:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+48:11256:x1870604213985664:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947498.836807:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947498.836835:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500640 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f11 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.836997:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.837013:0:8291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.837023:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.837064:0:8291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.837102:0:8291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 49 pid: 6511 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947498.837117:0:8291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236094848:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947498.837218:0:8291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947498.856217:0:8291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236094848:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947498.856252:0:8291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947498.856942:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947498.857033:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213985792 00000100:00100000:1.0:1783947498.857046:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213985792 00010000:00010000:1.0:1783947498.857112:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 50 pid: 6511 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947498.857406:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:1.0:1783947498.857418:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+50:2407:x1870604213985792:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947498.857511:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947498.857520:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 50 pid: 6511 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.857534:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 50 pid: 6511 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.857580:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550062b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f03 expref: 50 pid: 6511 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.857599:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947498.857605:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.857616:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.857624:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.857667:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947498.857728:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+49:2407:x1870604213985792:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 313us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947498.857735:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00010000:00010000:3.0:1783947498.860785:0:8291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.860809:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947498.860841:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1783947498.861076:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500640 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 50 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.861103:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 49 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947498.861114:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:3.0:1783947498.861118:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947498.861122:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50a00, rc 0) 00000100:00100000:3.0:1783947498.861205:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+49:11256:x1870604213985664:12345-192.168.204.3@tcp:101:bash.0 Request processed in 24448us (24761us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1783947498.861217:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:3.0:1783947498.866557:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947498.866640:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213986048 00000100:00100000:1.0:1783947498.866650:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213986048 00000100:00100000:1.0:1783947498.866718:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:1.0:1783947498.866729:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+49:11256:x1870604213986048:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:1.0:1783947498.867002:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.867023:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.867035:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947498.867110:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1783947498.867132:0:12193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000096acc92 reply state 000000007d0480f3 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.867144:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.867151:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947498.867154:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947498.867157:0:12193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947498.867242:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+52:11256:x1870604213986048:12345-192.168.204.3@tcp:36:bash.0 Request processed in 515us (695us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1783947498.867250:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000020:00080000:1.0:1783947498.867255:0:12193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947498.875637:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947498.875739:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213986176 00000100:00100000:1.0:1783947498.875748:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213986176 00000100:00100000:1.0:1783947498.875830:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:1.0:1783947498.875840:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+52:11256:x1870604213986176:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947498.875867:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947498.875888:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550065c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f18 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.876003:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.876018:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 53 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.876035:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.876066:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 53 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.876079:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 53 pid: 8291 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947498.876105:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9351500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236094976:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947498.876187:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c120c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947498.890593:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947498.894618:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213986304 00000100:00100000:2.0:1783947498.894632:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213986304 00010000:00010000:2.0:1783947498.894691:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 54 pid: 8291 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947498.894731:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:2.0:1783947498.894740:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+54:2407:x1870604213986304:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947498.895662:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947498.895678:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 54 pid: 8291 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.895714:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 54 pid: 8291 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.895742:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947498.895747:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.895778:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.895786:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947498.895809:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947498.895874:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+54:2407:x1870604213986304:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1135us (5291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947498.895883:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00010000:00010000:1.0:1783947498.898419:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500647 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f11 expref: 53 pid: 8291 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947498.898446:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9351500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236094976:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947498.898517:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.898528:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.898535:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947498.898603:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783947498.898607:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947498.898630:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.898696:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550065c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f18 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.898711:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f18 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947498.898721:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947498.898724:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947498.898727:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438000, rc 0) 00000100:00100000:1.0:1783947498.898809:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+52:11256:x1870604213986176:12345-192.168.204.3@tcp:101:bash.0 Request processed in 22969us (23182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947498.898820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:0.0:1783947498.903651:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947498.904117:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213986560 00000100:00100000:2.0:1783947498.904131:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213986560 00000100:00100000:2.0:1783947498.904230:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:2.0:1783947498.904240:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+52:11256:x1870604213986560:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:2.0:1783947498.904507:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+53:11256:x1870604213986560:12345-192.168.204.3@tcp:35:bash.0 Request processed in 269us (864us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1783947498.904515:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:3.0:1783947499.007792:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947499.007955:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213986816 00000100:00100000:0.0:1783947499.007964:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213986816 00000100:00080000:1.0:1783947499.008559:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947499.008653:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:0.0:1783947499.008667:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+53:11266:x1870604213986816:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947499.008695:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947499.008721:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550066a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f1f expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947499.008839:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783947499.008963:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550066a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f1f expref: 55 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.008993:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:0.0:1783947499.008996:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947499.009002:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb5550066a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f1f expref: 55 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.009031:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:0.0:1783947499.009100:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+54:11266:x1870604213986816:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 437us (1321us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1783947499.009108:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:3.0:1783947499.014591:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.014781:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213986944 00000100:00100000:2.0:1783947499.014792:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213986944 00000100:00100000:0.0:1783947499.014889:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:0.0:1783947499.014902:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+54:11266:x1870604213986944:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:0.0:1783947499.014989:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015007:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015019:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015031:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015037:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015043:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015134:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015153:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015178:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947499.015234:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015248:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015262:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015268:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015274:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.015278:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015286:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015299:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947499.015303:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.015308:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015314:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500678 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015328:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015340:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015346:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015351:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.015355:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015361:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015369:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:0.0:1783947499.015371:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.015374:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb5550067f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015391:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015398:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015403:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015408:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.015416:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015423:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015431:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947499.015433:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.015436:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.015441:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500686 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947499.015556:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+54:11266:x1870604213986944:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 656us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947499.015564:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:1.0:1783947499.020905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.021055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213987200 00000100:00100000:2.0:1783947499.021081:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213987200 00000100:00100000:2.0:1783947499.021147:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1783947499.021157:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+54:11266:x1870604213987200:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1783947499.021397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+55:11266:x1870604213987200:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 241us (502us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1783947499.021405:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:3.0:1783947499.076775:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.076945:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213987456 00000100:00100000:1.0:1783947499.076959:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213987456 00000100:00100000:1.0:1783947499.077033:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:1.0:1783947499.077044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac771aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+55:11269:x1870604213987456:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947499.077079:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947499.077107:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550068d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f26 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077212:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077232:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077278:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077292:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077298:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077305:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077522:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb555006a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077535:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb555006a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077543:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb555006a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947499.077558:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783947499.077673:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077679:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077684:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077688:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947499.077698:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077706:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077719:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947499.077721:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947499.077725:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077730:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55500694 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077870:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077878:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077883:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077888:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947499.077890:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077896:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077905:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:1.0:1783947499.077907:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947499.077916:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077921:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb5550069b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077964:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb5550068d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f26 expref: 58 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077979:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb555006a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f26 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.077987:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947499.077990:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947499.077992:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54a00, rc 0) 00000100:00100000:1.0:1783947499.078076:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac771aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+57:11269:x1870604213987456:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1034us (1334us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783947499.078085:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:2.0:1783947499.082188:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.082311:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.082399:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213987712 00000100:00100000:1.0:1783947499.082410:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213987712 00000100:00100000:1.0:1783947499.082512:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:1.0:1783947499.082523:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+57:11269:x1870604213987712:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1783947499.082595:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082611:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082622:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082674:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082680:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082686:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082692:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947499.082696:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082703:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082714:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947499.082717:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947499.082721:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.082728:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555006b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947499.082813:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+57:11269:x1870604213987712:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 292us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947499.082820:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:0.0:1783947499.082964:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213987584 00000100:00100000:0.0:1783947499.082969:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213987584 00000100:00100000:0.0:1783947499.083013:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1783947499.083020:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+57:2408:x1870604213987584:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947499.083031:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947499.083047:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb555006a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f26 expref: 57 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.083058:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947499.083061:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947499.083083:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+56:2408:x1870604213987584:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 64us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947499.083099:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1783947499.087814:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.088076:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213987968 00000100:00100000:2.0:1783947499.088085:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213987968 00000100:00100000:2.0:1783947499.088259:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:2.0:1783947499.088271:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+56:11269:x1870604213987968:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1783947499.088661:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+57:11269:x1870604213987968:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 392us (861us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1783947499.088666:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:2.0:1783947499.264058:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947499.265666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213988224 00000100:00100000:0.0:1783947499.265681:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213988224 00000100:00100000:0.0:1783947499.265769:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:0.0:1783947499.265779:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+57:11287:x1870604213988224:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:0.0:1783947499.265806:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947499.265831:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555006b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f2d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.265949:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555006be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.265966:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555006be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.265978:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555006be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947499.265989:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783947499.266102:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb555006b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f2d expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.266121:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555006be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f2d expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.266149:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947499.266152:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783947499.266169:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:0.0:1783947499.266348:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+59:11287:x1870604213988224:12345-192.168.204.3@tcp:101:cat.0 Request processed in 569us (2298us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1783947499.266356:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:0.0:1783947499.321914:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.322153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213988352 00000100:00100000:1.0:1783947499.322163:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213988352 00000100:00100000:1.0:1783947499.322229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:1.0:1783947499.322258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+59:11288:x1870604213988352:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947499.322280:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947499.322299:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f34 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.322353:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555006d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.322365:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555006d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.322374:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555006d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947499.322411:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783947499.322414:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947499.322428:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555006d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.322445:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f34 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.322500:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555006d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f34 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.322984:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947499.322987:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947499.322991:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54600, rc 0) 00000100:00100000:1.0:1783947499.323111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+60:11288:x1870604213988352:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 851us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947499.323131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:1.0:1783947499.329312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947499.329433:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213988736 00000100:00100000:0.0:1783947499.329444:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213988736 00000100:00100000:0.0:1783947499.329539:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:0.0:1783947499.329550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+60:11288:x1870604213988736:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947499.330518:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+61:11288:x1870604213988736:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 964us (1211us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1783947499.330763:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:2.0:1783947499.341128:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.341618:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213988864 00000100:00100000:1.0:1783947499.341629:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213988864 00000100:00100000:1.0:1783947499.341709:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1783947499.341721:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+61:11288:x1870604213988864:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:1.0:1783947499.341739:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783947499.341781:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb55500663 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f18 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.341802:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555006be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f2d expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.341815:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500560 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ed2 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.341826:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947499.341832:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947499.341897:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+58:11288:x1870604213988864:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 177us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947499.341905:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1783947499.355918:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.356136:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213988992 00000100:00100000:1.0:1783947499.356147:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213988992 00000100:00100000:1.0:1783947499.356213:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:1.0:1783947499.356224:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+58:11288:x1870604213988992:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:1.0:1783947499.356385:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.356409:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.356421:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947499.356721:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947499.356889:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1783947499.356979:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1783947499.357090:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+58:11288:x1870604213988992:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 867us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947499.357099:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:2.0:1783947499.392813:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.397279:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213989120 00000100:00100000:1.0:1783947499.397298:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213989120 00000100:00100000:1.0:1783947499.397379:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:1.0:1783947499.397391:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+58:11290:x1870604213989120:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947499.397420:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947499.397445:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb555006e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f3b expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397562:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397578:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397589:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397619:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397626:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397633:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397724:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397734:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397741:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947499.397801:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783947499.397806:0:12193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947499.397824:0:12193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397836:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397844:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397850:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397866:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397872:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947499.397877:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397885:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397898:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947499.397901:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947499.397906:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397912:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555006e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397926:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397932:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397938:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397942:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947499.397945:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397960:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397968:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:1.0:1783947499.397970:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947499.397972:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.397978:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555006ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.398006:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb555006e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 60 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.398020:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 59 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.398027:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947499.398030:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947499.398032:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54e00, rc 0) 00000100:00100000:1.0:1783947499.398362:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+59:11290:x1870604213989120:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 741us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947499.398370:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00010000:00010000:1.0:1783947499.701687:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947499.764383:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236095104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947499.764512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947499.764604:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947499.764611:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236095232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947499.764647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947499.765066:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236095104 00000100:00100000:0.0:1783947499.765079:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236095104 00000100:00100000:3.0:1783947499.766847:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236095232 00000100:00100000:3.0:1783947499.766863:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236095232 00000100:00100000:0.0:1783947499.767026:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783947499.767040:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236095104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947499.767092:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947499.767199:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236095104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947499.767207:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783947499.767995:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236095104:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1783947499.768936:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1783947499.768991:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1783947499.769009:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7bd2c12180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1783947499.769015:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bc4c40800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bd2c12d80 00000020:00080000:2.0:1783947499.769018:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bc4c40000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bc7f74a00 00010000:00010000:0.0:1783947499.769416:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769434:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769488:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769496:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.769502:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769513:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769536:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9e7bc5593e00) 00010000:00010000:0.0:1783947499.769539:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.769545:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769552:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550049c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769580:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769586:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769593:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769597:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ee00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.769601:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769620:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769630:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947499.769633:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.769636:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769641:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555004a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769658:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769664:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769670:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769675:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ac00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.769678:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769683:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769690:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bffb76a00) 00010000:00010000:0.0:1783947499.769692:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.769695:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769706:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555004e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769725:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769732:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769738:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769743:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9bc00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.769760:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769768:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769777:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947499.769780:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.769783:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769790:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb555005ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769803:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769810:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769825:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769830:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.769833:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769840:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769848:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947499.769850:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.769853:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769860:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb5550060f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769872:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769879:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769886:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769891:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947499.769894:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769910:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769919:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:0.0:1783947499.769921:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947499.769923:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947499.769929:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55500655 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783947499.770412:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1783947499.770515:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1783947499.770774:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783947499.770947:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236095360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783947499.771057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947499.772232:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783947499.772251:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236095232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947499.772289:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947499.772381:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236095232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (7730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947499.772390:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783947499.772451:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236095232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947499.773552:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236095360 00000100:00100000:2.0:1783947499.773581:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236095360 00000100:00100000:2.0:1783947499.773658:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947499.773670:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604236095360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783947499.773702:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1783947499.773738:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a54e0e8, atime: 0x6a54e0e8, ctime: 0x6a54e0e8, blocks: 0x8 00010000:00010000:2.0:1783947499.773754:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.773771:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1783947499.773775:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947499.773781:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.773798:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.773808:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.773815:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.773833:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1783947499.774083:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783947499.776789:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947499.776803:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.776818:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947499.776822:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.776877:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.776905:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.776912:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000631f9d3e/0xe6fd1fdb555006fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.776957:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947499.776959:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947499.776961:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783947499.777081:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7bd9352a00/2, rc 0, transno 4294967302 00000100:00100000:0.0:1783947499.777100:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236095360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783947499.784635:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236095360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10954us (13563us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783947499.784652:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:0.0:1783947499.897886:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947499.897896:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947499.897937:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783947499.897946:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947499.898086:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e40000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236095488:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783947499.898212:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947499.908025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.908066:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213989248 00000100:00100000:2.0:1783947499.908073:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213989248 00000100:00100000:2.0:1783947499.908118:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1783947499.908125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213989248:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947499.908156:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947499.908298:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213989248:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 172us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947499.908306:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:3.0:1783947499.914617:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e40000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236095488:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947499.920857:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.921136:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213989376 00000100:00100000:2.0:1783947499.921146:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213989376 00000100:00100000:2.0:1783947499.921220:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:2.0:1783947499.921238:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+12:11301:x1870604213989376:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783947499.921318:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.921340:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.921355:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.921410:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.921417:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.921425:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922072:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922085:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922093:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947499.922150:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783947499.922155:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947499.922167:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922178:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922185:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922203:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922210:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947499.922214:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922221:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922401:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:2.0:1783947499.922410:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947499.922415:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922421:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500704 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922434:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922439:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922444:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922449:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947499.922453:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922533:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922540:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9e7bc5593d00) 00010000:00010000:2.0:1783947499.922542:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947499.922545:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922550:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550070b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922565:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922578:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922583:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922588:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ee00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947499.922591:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922597:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922605:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947499.922607:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947499.922610:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.922616:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500712 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947499.922741:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+12:11301:x1870604213989376:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 1508us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947499.922758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:2.0:1783947499.926738:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.927383:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213989632 00000100:00100000:1.0:1783947499.927395:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213989632 00000100:00100000:1.0:1783947499.927476:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:1.0:1783947499.927487:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+12:11301:x1870604213989632:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947499.927513:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947499.927536:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500719 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f42 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927656:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927671:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927684:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947499.927696:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783947499.927808:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927817:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927824:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927830:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947499.927835:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927855:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927870:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:1.0:1783947499.927873:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947499.927891:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927898:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500720 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927941:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500719 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f42 expref: 14 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927953:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:1.0:1783947499.927956:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947499.927960:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500719 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f42 expref: 14 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.927969:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54400, rc 0) 00000100:00100000:1.0:1783947499.928042:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213989632:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 557us (1314us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1783947499.928050:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:0.0:1783947499.935857:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947499.935942:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213989760 00000100:00100000:3.0:1783947499.935963:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213989760 00000100:00100000:3.0:1783947499.936026:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:3.0:1783947499.936037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213989760:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947499.936077:0:6511:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783947499.936215:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213989760:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947499.936222:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:1.0:1783947499.942025:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.945527:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213990016 00000100:00100000:2.0:1783947499.945544:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213990016 00000100:00100000:2.0:1783947499.945617:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:2.0:1783947499.945628:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213990016:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947499.945662:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947499.945666:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783947499.945697:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555006d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f34 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.945715:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:2.0:1783947499.945721:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947499.945735:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550072e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f49 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947499.946180:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783947499.946344:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500735 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.946356:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.946367:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.946418:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550072e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f49 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.946434:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f49 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.946442:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bc5593d00) 00010000:00010000:2.0:1783947499.946445:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947499.946454:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f000, rc 0) 00000100:00100000:2.0:1783947499.946541:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+14:11301:x1870604213990016:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 915us (4522us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1783947499.946550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:2.0:1783947499.959389:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947499.959423:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213990272 00000100:00100000:2.0:1783947499.959432:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213990272 00000100:00100000:2.0:1783947499.959495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:2.0:1783947499.959506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+14:11301:x1870604213990272:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947499.959630:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947499.959658:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500735 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f49 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.959676:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bc5593d00) 00010000:00010000:2.0:1783947499.959685:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947499.959707:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.959721:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.959980:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.959998:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960006:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960029:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960079:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960085:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960092:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960098:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947499.960102:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960109:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960117:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:2.0:1783947499.960119:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947499.960122:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960129:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500743 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960138:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960144:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960154:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960159:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947499.960162:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960168:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960174:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe9e07e6b (ffff9e7bc5593000) 00010000:00010000:2.0:1783947499.960176:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947499.960178:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947499.960184:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550074a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe9e07e6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947499.960271:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213990272:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 766us (888us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947499.960278:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:3.0:1783947499.963001:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.963240:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213990400 00000100:00100000:1.0:1783947499.963251:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213990400 00000100:00100000:1.0:1783947499.963309:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:1.0:1783947499.963320:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+13:11301:x1870604213990400:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947499.963353:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947499.963377:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500751 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f50 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.963412:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.963425:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.963437:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.963574:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500751 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 15 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.963590:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 14 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.963599:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:1.0:1783947499.963602:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947499.963606:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55e00, rc 0) 00000100:00100000:1.0:1783947499.963663:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+14:11301:x1870604213990400:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 345us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947499.963669:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:2.0:1783947499.968504:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.968654:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213990656 00000100:00100000:1.0:1783947499.968664:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213990656 00000100:00100000:1.0:1783947499.968729:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00100000:1.0:1783947499.968740:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+14:11301:x1870604213990656:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947499.968854:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.968874:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.968885:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947499.969072:0:12193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1783947499.969083:0:12193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385196625092ns, next at 386196622672ns, rc = 0 00000004:00010000:1.0:1783947499.969140:0:12193:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000899abae9 reply state 00000000077c5f24 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.969154:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947499.969162:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:1.0:1783947499.969164:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783947499.969168:0:12193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947499.972515:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+16:11301:x1870604213990656:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 3763us (4009us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1783947499.972530:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00100000:1.0:1783947499.976082:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947499.976223:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213990784 00000100:00100000:3.0:1783947499.976374:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213990784 00000100:00100000:3.0:1783947499.976442:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:3.0:1783947499.976452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+16:11301:x1870604213990784:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947499.976517:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947499.976541:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f57 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.976607:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.976646:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947499.976670:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:3.0:1783947499.976673:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947499.976677:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50200, rc 0) 00000100:00100000:3.0:1783947499.976737:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+17:11301:x1870604213990784:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 286us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947499.976754:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:3.0:1783947499.983717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947499.993615:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213990912 00000100:00100000:1.0:1783947499.993630:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213990912 00000100:00100000:1.0:1783947499.993681:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:1.0:1783947499.993690:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604213990912:12345-192.168.204.3@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1783947499.993726:0:8427:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:1.0:1783947499.993772:0:8427:0:(genops.c:1406:class_connect()) connect: client 1eb923ac-790a-478f-897e-124614dbce09, cookie 0xe6fd1fdb5550076d 00002000:00100000:1.0:1783947499.993784:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1eb923ac-790a-478f-897e-124614dbce09/ffff9e7c01d49800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783947499.993796:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783947499.993878:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783947499.993912:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e7c01d4c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947499.993997:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2405:x1870604213990912:12345-192.168.204.3@tcp:8:lhsmtool_posix.0 Request processed in 306us (10290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947499.994007:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:2.0:1783947500.003209:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.004042:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213991040 00000100:00100000:1.0:1783947500.004055:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213991040 00000100:00100000:1.0:1783947500.004131:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:1.0:1783947500.004142:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+6:0:x1870604213991040:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783947500.004367:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1783947500.005838:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1783947500.005850:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000100:00100000:3.0:1783947500.006329:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.006366:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.006396:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.006419:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.006488:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213991296 00000100:00100000:1.0:1783947500.006497:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213991296 00000100:00100000:1.0:1783947500.006549:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213991552 00000100:00100000:1.0:1783947500.006552:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213991552 00000100:00100000:1.0:1783947500.006576:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 279 00000100:00100000:1.0:1783947500.006585:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213991296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947500.006656:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604213991296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 72us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.006665:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 279 00000100:00100000:1.0:1783947500.006683:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 280 00000100:00100000:1.0:1783947500.006689:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213991552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947500.006722:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213991552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.006728:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 280 00000100:00100000:1.0:1783947500.006757:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213991168 00000100:00100000:1.0:1783947500.006760:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213991168 00000100:00100000:1.0:1783947500.006787:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 378 00000100:00100000:1.0:1783947500.006794:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213991168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947500.006820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604213991168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.006826:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 378 00000100:00080000:3.0:1783947500.007271:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947500.007276:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947500.007569:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213991424 00000100:00100000:3.0:1783947500.007575:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213991424 00000100:00100000:3.0:1783947500.007663:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:3.0:1783947500.007672:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+7:2409:x1870604213991424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947500.007721:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+7:2409:x1870604213991424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 50us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.007728:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:3.0:1783947500.007790:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00080000:1.0:1783947500.008042:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947500.008057:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213991680 00000100:00100000:1.0:1783947500.008060:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213991680 00000100:00100000:1.0:1783947500.008123:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 281 00000100:00100000:1.0:1783947500.008130:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213991680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947500.008163:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604213991680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.008169:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 281 00000100:00100000:2.0:1783947500.008269:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:0:x1870604213991040:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 4128us (5132us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783947500.008277:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00080000:1.0:1783947500.010089:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947500.010666:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.010761:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213991936 00000100:00100000:2.0:1783947500.010771:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213991936 00000100:00100000:2.0:1783947500.010833:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:2.0:1783947500.010844:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+17:11301:x1870604213991936:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783947500.011097:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+18:11301:x1870604213991936:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 253us (436us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1783947500.011104:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:2.0:1783947500.014246:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.014661:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213992192 00000100:00100000:3.0:1783947500.014671:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213992192 00000100:00100000:3.0:1783947500.014764:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00100000:3.0:1783947500.014774:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:11301:x1870604213992192:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947500.014889:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:11301:x1870604213992192:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 117us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.014897:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00100000:2.0:1783947500.023035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.023620:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213992320 00000100:00100000:3.0:1783947500.023632:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213992320 00000100:00100000:3.0:1783947500.023694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 88 00000100:00100000:3.0:1783947500.023704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:11301:x1870604213992320:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947500.023727:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947500.023828:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500774 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f5e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.023965:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb5550077b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.023980:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb5550077b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.023993:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb5550077b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947500.024041:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947500.024063:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb5550077b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.024090:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500774 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f5e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.024128:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb5550077b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f5e expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.024136:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:3.0:1783947500.024439:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783947500.024443:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50c00, rc 0) 00000100:00100000:3.0:1783947500.024531:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:11301:x1870604213992320:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 828us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.024539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 88 00000100:00100000:3.0:1783947500.028546:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947500.028968:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213992448 00000100:00100000:0.0:1783947500.028978:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213992448 00000100:00100000:0.0:1783947500.029067:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:0.0:1783947500.029079:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604213992448:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947500.029108:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947500.029136:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f65 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947500.029161:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e0ea, blocks: 0x0 00010000:00010000:0.0:1783947500.029181:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1783947500.029185:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947500.029195:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 6 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.029216:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 6 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.029240:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:0.0:1783947500.029307:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213992448:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 230us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947500.029314:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:1.0:1783947500.039772:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.039916:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213992704 00000100:00100000:3.0:1783947500.039925:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213992704 00000100:00100000:3.0:1783947500.040058:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:3.0:1783947500.040069:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+19:11301:x1870604213992704:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947500.040215:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+19:11301:x1870604213992704:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 148us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.040223:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:2.0:1783947500.051918:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.051988:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213992832 00000100:00100000:3.0:1783947500.051999:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213992832 00000100:00100000:3.0:1783947500.052063:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:3.0:1783947500.052074:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+6:11301:x1870604213992832:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947500.052093:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947500.052112:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f6c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.052161:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 7 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.052169:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947500.052173:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947500.052179:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.052212:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 7 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.052225:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 7 pid: 8539 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.052240:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870604236095616:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947500.052368:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947500.058960:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.059028:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213992960 00000100:00100000:2.0:1783947500.059037:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213992960 00010000:00010000:2.0:1783947500.059076:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 8 pid: 8539 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.059116:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1783947500.059124:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604213992960:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947500.059140:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947500.059163:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 8 pid: 8539 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.059177:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 8 pid: 8539 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.059205:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947500.059210:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947500.059219:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.059257:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.059298:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.059315:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd8067100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1870604236095744:192.168.204.3@tcp:105: 00000100:00100000:2.0:1783947500.059396:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd480 going to sleep for 11 seconds 00010000:00010000:3.0:1783947500.059869:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088998405/0xe6fd1fdb55500782 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f65 expref: 8 pid: 8539 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.059887:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870604236095616:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947500.059913:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.059930:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50e00, rc 0) 00000100:00100000:3.0:1783947500.059985:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+7:11301:x1870604213992832:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 7913us (8079us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.059993:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:2.0:1783947500.066310:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd8067100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1870604236095744:192.168.204.3@tcp:105: 00010000:00010000:2.0:1783947500.066341:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947500.066408:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604213992960:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 7279us (7456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.066420:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1783947500.069418:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.069540:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213993088 00000100:00100000:1.0:1783947500.069550:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213993088 00002000:00100000:1.0:1783947500.069595:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9e7bd8067100 x1870604213993088/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:291/0 lens 504/0 e 0 to 0 dl 1783947511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947500.069606:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7bd8067100 with x1870604213993088 ext(0->8) 00002000:00010000:1.0:1783947500.069611:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7bd8067100 00000100:00100000:1.0:1783947500.069659:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:1.0:1783947500.069669:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213993088:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783947500.072150:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1eb923ac-790a-478f-897e-124614dbce09+8:2409:x1870604213993088:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 2470us (2729us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783947500.072168:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00002000:00100000:1.0:1783947500.072182:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9e7bd8067100 x1870604213993088/t4294967303(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:291/0 lens 504/448 e 0 to 0 dl 1783947511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947500.072193:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7bd8067100 with x1870604213993088 ext(0->8) 00002000:00010000:1.0:1783947500.072199:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7bd8067100 00000100:00100000:1.0:1783947500.082287:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.082416:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213993216 00000100:00100000:3.0:1783947500.082426:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213993216 00000100:00100000:2.0:1783947500.083375:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:2.0:1783947500.083394:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:11301:x1870604213993216:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783947500.085400:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1783947500.085415:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783947500.085444:0:6489:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1783947500.085626:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947500.085647:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236095872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783947500.085720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947500.085785:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236095872 00000100:00100000:3.0:1783947500.085791:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236095872 00000100:00100000:3.0:1783947500.085836:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947500.085845:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236095872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783947500.086009:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783947500.086013:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783947499 00002000:00010000:3.0:1783947500.086015:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783947500.086017:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783947498 -> 1783947499 00002000:00010000:3.0:1783947500.086019:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783947500.086058:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604236095872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (337us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783947500.086065:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1783947500.086108:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7ac7e1f800/2, rc 0, transno 4294967304 00000100:00100000:3.0:1783947500.086114:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236095872:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1783947500.086493:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1783947500.086506:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1783947500.086615:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+15:11301:x1870604213993216:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 3226us (4337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.086624:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 90 00010000:00010000:1.0:1783947500.087896:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.087911:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.087925:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.087932:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947500.087937:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.087945:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.087963:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:1.0:1783947500.087966:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947500.087989:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.087996:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550075f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947500.090441:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.090638:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213993344 00000100:00100000:2.0:1783947500.090648:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213993344 00000100:00100000:2.0:1783947500.090705:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:2.0:1783947500.090729:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604213993344:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783947500.092576:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1783947500.092592:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1783947500.093010:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604213993344:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 2277us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.093023:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1783947500.098139:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947500.098308:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213993600 00000100:00100000:0.0:1783947500.098319:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213993600 00000100:00100000:0.0:1783947500.098377:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:0.0:1783947500.098387:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+14:11301:x1870604213993600:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783947500.098496:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947500.098525:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb5550077b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f5e expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.098544:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:0.0:1783947500.098549:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947500.098578:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.098590:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.098600:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947500.098750:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec1ea53e reply state 00000000929f71c8 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.098763:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.098770:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:0.0:1783947500.098773:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947500.098776:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947500.098884:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+15:11301:x1870604213993600:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 497us (753us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1783947500.098892:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:3.0:1783947500.103163:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.103333:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213993728 00000100:00100000:2.0:1783947500.103344:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213993728 00000100:00100000:2.0:1783947500.103406:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:2.0:1783947500.103418:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604213993728:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783947500.103654:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783947500.103658:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783947499 -> 1783947497 00002000:00010000:2.0:1783947500.103660:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783947496 00002000:00010000:2.0:1783947500.103662:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783947499 -> 1783947497 00002000:00010000:2.0:1783947500.103664:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783947500.103726:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+7:2409:x1870604213993728:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 311us (571us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783947500.103752:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947500.107885:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947500.109046:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213993984 00000100:00100000:0.0:1783947500.109061:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213993984 00000100:00100000:0.0:1783947500.109149:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 92 00000100:00100000:0.0:1783947500.109176:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+15:11301:x1870604213993984:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783947500.109478:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.109497:0:8291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 15 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.109508:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.109546:0:8291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 15 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.109561:0:8291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 15 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947500.109576:0:8291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e42680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236096000:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947500.109679:0:8291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947500.112876:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.112968:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213994112 00000100:00100000:2.0:1783947500.112978:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213994112 00010000:00010000:2.0:1783947500.113021:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 16 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.113067:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:2.0:1783947500.113077:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+16:2407:x1870604213994112:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947500.113093:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947500.113099:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 16 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.113126:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 16 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.113154:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:2.0:1783947500.113160:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.113172:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.113180:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.113203:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947500.113272:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+16:2407:x1870604213994112:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 196us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.113280:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00010000:00010000:1.0:1783947500.113521:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f50 expref: 15 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947500.113537:0:8291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e42680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236096000:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947500.113560:0:8291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113569:0:8291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113575:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113617:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113624:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113631:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113638:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947500.113643:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113659:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113669:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:1.0:1783947500.113671:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783947500.113675:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.113681:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500797 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947500.113724:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+14:11301:x1870604213993984:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 4550us (5862us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783947500.113733:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 92 00000100:00100000:3.0:1783947500.117380:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.117497:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213994240 00000100:00100000:1.0:1783947500.117508:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213994240 00000100:00100000:1.0:1783947500.117571:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:1.0:1783947500.117580:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2408:x1870604213994240:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783947500.117626:0:10351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.117648:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.117657:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947500.117661:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947500.117666:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.117705:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.117719:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 7 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947500.117733:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10351:1870604236096128:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947500.117828:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947500.121168:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10351:1870604236096128:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947500.121200:0:10351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.123275:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.123380:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213994368 00000100:00100000:1.0:1783947500.123389:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213994368 00010000:00010000:1.0:1783947500.123446:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 8 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947500.123517:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:1.0:1783947500.123528:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604213994368:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947500.123543:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947500.123565:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 8 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.123579:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 8 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.123610:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb55500789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f6c expref: 8 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.123629:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947500.123634:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947500.123640:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.123650:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.123674:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947500.123725:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604213994368:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 199us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.123732:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00010000:00010000:2.0:1783947500.123816:0:10351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123826:0:10351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123845:0:10351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123853:0:10351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123876:0:10351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123885:0:10351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947500.123889:0:10351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123897:0:10351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123908:0:10351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.123923:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6e08fb/0xe6fd1fdb5550079e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.123972:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604213994240:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 6393us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.123980:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:3.0:1783947500.127755:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.128775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213994624 00000100:00100000:2.0:1783947500.128787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213994624 00000100:00100000:2.0:1783947500.129032:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 93 00000100:00100000:2.0:1783947500.129044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+14:11301:x1870604213994624:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783947500.129131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.129155:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 14 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.129164:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.129205:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 14 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.129218:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 14 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.129247:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236096256:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947500.129342:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd480 going to sleep for 11 seconds 00000100:00100000:3.0:1783947500.133070:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236096256:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947500.133102:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947500.143608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.143782:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213994752 00000100:00100000:2.0:1783947500.143793:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213994752 00010000:00010000:2.0:1783947500.143837:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 15 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.143887:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:2.0:1783947500.143897:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+15:2406:x1870604213994752:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947500.143923:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947500.143931:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 15 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.143945:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 15 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.143980:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555005e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ef5 expref: 15 pid: 8291 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.143993:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947500.143999:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.144009:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.144018:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.144044:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947500.144098:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+14:2406:x1870604213994752:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 202us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.144106:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00010000:00010000:3.0:1783947500.145636:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.145652:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.145911:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.146050:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.146059:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.146098:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.146115:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 14 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.146131:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236096384:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947500.146408:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947500.149658:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236096384:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947500.149702:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.151264:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.151384:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213994880 00000100:00100000:3.0:1783947500.151394:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213994880 00010000:00010000:3.0:1783947500.151436:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.151908:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:3.0:1783947500.151921:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+15:2406:x1870604213994880:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947500.151937:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947500.151945:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.151959:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.151983:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500766 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f57 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.151999:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:3.0:1783947500.152004:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.152133:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.152142:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.152232:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947500.152305:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+14:2406:x1870604213994880:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 386us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.152312:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00010000:00010000:2.0:1783947500.156419:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.156733:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947500.157000:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1783947500.157121:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1783947500.157339:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1783947500.157586:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd8064700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1870604236096512:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783947500.157662:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947500.157759:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947500.157808:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236096512 00000100:00100000:1.0:1783947500.157816:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236096512 00000100:00100000:1.0:1783947500.158003:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783947500.158016:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1870604236096512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783947500.158156:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1870604236096512:12345-0@lo:1000:mdt00_002.0 Request processed in 143us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.158164:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783947500.158371:0:6512:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1783947500.158377:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7ac7e1f800, transno 4294967304 00000100:00100000:2.0:1783947500.158437:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd8064700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1870604236096512:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783947500.158584:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1783947500.158634:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd8064700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1870604236096640:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783947500.158666:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947500.158694:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236096640 00000100:00100000:2.0:1783947500.158698:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236096640 00000100:00100000:2.0:1783947500.158724:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783947500.158731:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1870604236096640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783947500.158854:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6512:x1870604236096640:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (188us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783947500.158861:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783947500.158893:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cde40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947500.158987:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd8064700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1870604236096640:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783947500.159025:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159035:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159042:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159048:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947500.159052:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159070:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159087:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:2.0:1783947500.159090:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947500.159095:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159101:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555007ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159132:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159207:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159213:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159218:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947500.159221:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159237:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159246:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947500.159248:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947500.159252:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159267:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555006da lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159378:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159393:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 17 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159402:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159437:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 17 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.159450:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 17 pid: 12193 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.159477:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236096768:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947500.159635:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1783947500.168143:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.168177:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213995008 00000100:00100000:2.0:1783947500.168185:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213995008 00010000:00010000:2.0:1783947500.168246:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 18 pid: 12193 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.168298:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:2.0:1783947500.168308:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+18:2407:x1870604213995008:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947500.168333:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947500.168341:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 18 pid: 12193 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168354:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 18 pid: 12193 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168378:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947500.168384:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168394:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168402:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168420:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947500.168493:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+18:2407:x1870604213995008:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 186us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.168500:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00010000:00010000:2.0:1783947500.168631:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555006f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f3b expref: 17 pid: 12193 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.168646:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236096768:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947500.168665:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168674:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168686:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168697:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168702:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168708:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168714:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ee00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947500.168718:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168725:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168734:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947500.168736:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947500.168751:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168756:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555007b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168766:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168771:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168783:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168788:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947500.168791:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168797:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168806:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bffb76f00) 00010000:00010000:2.0:1783947500.168808:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947500.168811:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.168816:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb555007a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947500.169043:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947500.169048:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947500.169080:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783947500.169088:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947500.169167:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+16:11301:x1870604213994624:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 40124us (41428us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1783947500.169175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 93 00000020:00080000:2.0:1783947500.169180:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1783947500.178850:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.178945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213995264 00000100:00100000:3.0:1783947500.181890:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213995264 00000100:00100000:3.0:1783947500.181985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1783947500.181997:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+16:11301:x1870604213995264:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783947500.182431:0:6514:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783947500.182488:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1783947500.182525:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182544:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182556:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182564:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182570:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182577:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182595:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783947500.182695:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+18:11301:x1870604213995264:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 699us (3853us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1783947500.182703:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000020:00080000:3.0:1783947500.182709:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783947500.182968:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947500.182975:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182982:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947500.182987:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.182995:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.183067:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:3.0:1783947500.183071:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783947500.183077:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.183087:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555007ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.183098:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947500.183100:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947500.183102:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947500.275570:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947500.275595:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236096896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947500.275673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947500.275948:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236096896 00000100:00100000:3.0:1783947500.275955:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236096896 00000100:00100000:3.0:1783947500.276019:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783947500.276030:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236096896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947500.276070:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947500.276145:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236096896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.276153:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783947500.276358:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236096896:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783947500.281446:0:14204:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947500.281485:0:14204:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947500.281509:0:14204:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783947500.281514:0:14204:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947500.457116:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.457215:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213995520 00000100:00100000:1.0:1783947500.457225:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213995520 00000100:00100000:1.0:1783947500.457291:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 94 00000100:00100000:1.0:1783947500.457302:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+18:11311:x1870604213995520:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947500.457355:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947500.457379:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555007c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f73 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.457540:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55a00/0xe6fd1fdb555007c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.457556:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55a00/0xe6fd1fdb555007c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.457567:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55a00/0xe6fd1fdb555007c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947500.457578:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783947500.457691:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555007c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f73 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.457708:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55a00/0xe6fd1fdb555007c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f73 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.457717:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947500.457720:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947500.457723:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55a00, rc 0) 00000100:00100000:1.0:1783947500.457798:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+20:11311:x1870604213995520:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 497us (692us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1783947500.457806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 94 00000100:00100000:3.0:1783947500.459922:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.460037:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213995648 00000100:00100000:1.0:1783947500.460048:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213995648 00000100:00100000:1.0:1783947500.460114:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 95 00000100:00100000:1.0:1783947500.460143:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+20:11311:x1870604213995648:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1783947500.460212:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460227:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460239:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460252:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460258:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460264:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460745:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460755:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460762:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947500.460812:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460825:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460839:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460846:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460852:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947500.460856:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460863:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460875:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947500.460878:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947500.460883:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460888:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555007d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460900:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460905:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460911:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460916:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947500.460925:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460932:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460939:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bd00) 00010000:00010000:1.0:1783947500.460942:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947500.460945:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460951:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555007dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460969:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460975:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460981:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460986:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947500.460989:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.460996:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.461004:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7bd555bc00) 00010000:00010000:1.0:1783947500.461007:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947500.461017:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.461023:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555007e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947500.461147:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+20:11311:x1870604213995648:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 1005us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.461156:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 95 00000100:00100000:3.0:1783947500.516043:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947500.516162:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213995904 00000100:00100000:0.0:1783947500.516172:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213995904 00000100:00100000:0.0:1783947500.516244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00100000:0.0:1783947500.516255:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+20:11314:x1870604213995904:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947500.516276:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947500.516300:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555007eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f7a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516400:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516416:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516428:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516444:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516452:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516497:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516637:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516646:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516654:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947500.516663:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783947500.516758:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516765:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516778:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516783:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947500.516787:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516794:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516808:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947500.516811:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947500.516815:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516822:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb555007f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516836:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516843:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516851:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516855:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947500.516857:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516872:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516880:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7c003e5d00) 00010000:00010000:0.0:1783947500.516883:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947500.516885:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516891:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb555007f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516928:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555007eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516943:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.516950:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:0.0:1783947500.516953:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947500.516955:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b200, rc 0) 00000100:00100000:0.0:1783947500.517017:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+22:11314:x1870604213995904:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 764us (984us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783947500.517025:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00100000:2.0:1783947500.529843:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.530094:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213996032 00000100:00100000:3.0:1783947500.530106:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213996032 00000100:00100000:3.0:1783947500.530180:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:3.0:1783947500.530195:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+22:11314:x1870604213996032:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:3.0:1783947500.530281:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530298:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530311:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530351:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530359:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530366:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530373:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947500.530378:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530398:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530411:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:3.0:1783947500.530414:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947500.530420:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.530426:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb5550080e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.530539:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+22:11314:x1870604213996032:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 350us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.530548:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:3.0:1783947500.532785:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.542000:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213996288 00000100:00100000:2.0:1783947500.542019:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213996288 00000100:00100000:2.0:1783947500.542506:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1783947500.542519:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+22:11314:x1870604213996288:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1783947500.542775:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+23:11314:x1870604213996288:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 258us (9998us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1783947500.542783:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:3.0:1783947500.584535:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.584828:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213996544 00000100:00100000:1.0:1783947500.584839:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213996544 00000100:00100000:1.0:1783947500.584918:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:1.0:1783947500.584930:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+23:10840:x1870604213996544:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947500.584957:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947500.584980:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500815 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f81 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.585098:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.585113:0:8291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.585123:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.585157:0:8291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.585170:0:8291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 24 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947500.585196:0:8291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236097024:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947500.585292:0:8291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947500.598616:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.598820:0:8291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236097024:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947500.598851:0:8291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.599120:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213996672 00000100:00100000:2.0:1783947500.599128:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213996672 00010000:00010000:2.0:1783947500.599168:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 25 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947500.599210:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:2.0:1783947500.599230:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+25:2407:x1870604213996672:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947500.599246:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947500.599253:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 25 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.599266:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 25 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.599287:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f7a expref: 25 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.599312:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:2.0:1783947500.599316:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.599326:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.599334:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.599359:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947500.599412:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+24:2407:x1870604213996672:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 183us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.599420:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00010000:00010000:2.0:1783947500.600844:0:8291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.600857:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947500.600878:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783947500.601024:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500815 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 25 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.601042:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 24 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.601050:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:2.0:1783947500.601060:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783947500.601064:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54000, rc 0) 00000100:00100000:2.0:1783947500.601112:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+24:10840:x1870604213996544:12345-192.168.204.3@tcp:101:bash.0 Request processed in 16185us (16589us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1783947500.601120:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:1.0:1783947500.618380:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.618418:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213996800 00000100:00100000:1.0:1783947500.618428:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213996800 00000100:00100000:1.0:1783947500.618516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:1.0:1783947500.618529:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+24:10840:x1870604213996800:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947500.618554:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947500.618577:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb5550082a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.618616:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500831 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.618632:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.618645:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500831 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.618781:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb5550082a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f88 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.618798:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500831 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f88 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.618820:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:1.0:1783947500.618824:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947500.618827:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54200, rc 0) 00000100:00100000:1.0:1783947500.618899:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+25:10840:x1870604213996800:12345-192.168.204.3@tcp:101:bash.0 Request processed in 372us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.618907:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:1.0:1783947500.633181:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.633326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213997056 00000100:00100000:3.0:1783947500.633336:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213997056 00000100:00100000:3.0:1783947500.633401:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 100 00000100:00100000:3.0:1783947500.633411:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+25:10840:x1870604213997056:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:3.0:1783947500.633685:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.633706:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.633746:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947500.633792:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1783947500.633816:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb0a06ed reply state 000000005e7a6ef1 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.633829:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.633837:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:3.0:1783947500.633839:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947500.633843:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783947500.633900:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1783947500.633994:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+29:10840:x1870604213997056:12345-192.168.204.3@tcp:36:bash.0 Request processed in 583us (821us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1783947500.634001:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 100 00000020:00080000:3.0:1783947500.634006:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783947500.644306:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.644385:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213997184 00000100:00100000:3.0:1783947500.644396:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213997184 00000100:00100000:1.0:1783947500.644697:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 101 00000100:00100000:1.0:1783947500.644711:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+29:10840:x1870604213997184:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947500.644748:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947500.644771:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb5550083f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f8f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.644832:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb5550083f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f8f expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.644847:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb5550083f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f8f expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.644878:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:1.0:1783947500.644882:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783947500.644886:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54a00, rc 0) 00000100:00100000:1.0:1783947500.645629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+30:10840:x1870604213997184:12345-192.168.204.3@tcp:101:bash.0 Request processed in 248us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.645640:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 101 00000100:00100000:1.0:1783947500.652318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.655308:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213997312 00000100:00100000:2.0:1783947500.655322:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213997312 00000100:00100000:2.0:1783947500.655407:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:2.0:1783947500.655418:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+6:10840:x1870604213997312:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947500.655438:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947500.655491:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f96 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947500.655518:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a54e0e9, atime: 0x6a54e0e8, ctime: 0x6a54e0e9, blocks: 0x8 00010000:00010000:2.0:1783947500.655543:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1783947500.655548:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947500.655557:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.655576:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947500.655588:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ec00, rc 0) 00000100:00100000:2.0:1783947500.655651:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:10840:x1870604213997312:12345-192.168.204.3@tcp:101:bash.0 Request processed in 235us (3342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947500.655675:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:2.0:1783947500.660662:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.660762:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213997440 00000100:00100000:1.0:1783947500.660772:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213997440 00002000:00010000:1.0:1783947500.660815:0:8432:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1783947500.660820:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7f9bb80 with x1870604213997440 ext(0->18446744073709551615) 00002000:00010000:1.0:1783947500.660834:0:8432:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac7f9bb80. 00000100:00100000:2.0:1783947500.660964:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1783947500.660977:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604213997440:12345-192.168.204.3@tcp:10:bash.0 00002000:00010000:2.0:1783947500.661286:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783947500.661290:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783947497 -> 1783947499 00002000:00010000:2.0:1783947500.661293:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1783947496 -> 1783947496 00002000:00010000:2.0:1783947500.661295:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783947497 -> 1783947499 00002000:00010000:2.0:1783947500.661298:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1783947500.661371:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604213997440:12345-192.168.204.3@tcp:10:bash.0 Request processed in 397us (718us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783947500.661379:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00002000:00010000:2.0:1783947500.661383:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1783947500.661386:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7f9bb80 with x1870604213997440 ext(0->18446744073709551615) 00002000:00010000:2.0:1783947500.661391:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac7f9bb80. 00010000:00010000:0.0:1783947500.724029:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947500.756795:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947500.757081:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213997568 00000100:00100000:3.0:1783947500.757156:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213997568 00000100:00100000:3.0:1783947500.757518:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 102 00000100:00100000:3.0:1783947500.757535:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+30:11328:x1870604213997568:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:3.0:1783947500.757645:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.757669:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.757705:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.757724:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.757741:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.757749:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.757844:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.760570:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.760604:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947500.761409:0:12193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761436:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761444:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761452:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761538:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947500.761544:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761554:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761574:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947500.761578:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947500.761584:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761592:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb5550084d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761619:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761625:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761632:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761637:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947500.761640:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761647:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761665:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bfcb9ff00) 00010000:00010000:3.0:1783947500.761668:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947500.761671:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761679:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500854 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761701:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761707:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761712:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761717:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947500.761720:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761737:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761746:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:3.0:1783947500.761748:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947500.761752:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.761757:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb5550085b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.766209:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+30:11328:x1870604213997568:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 6306us (7058us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.766244:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 102 00000100:00100000:3.0:1783947500.811867:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.819059:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213997824 00000100:00100000:1.0:1783947500.819073:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213997824 00000100:00100000:1.0:1783947500.819438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 103 00000100:00100000:1.0:1783947500.820313:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+30:11331:x1870604213997824:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947500.820414:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947500.820443:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500862 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3f9d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.820648:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.820665:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.820682:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.820700:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.820708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.820716:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.822109:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500877 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.822411:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.822423:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947500.822438:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783947500.823544:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823558:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823565:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823570:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947500.823575:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823583:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823598:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947500.823601:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947500.823606:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823629:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500869 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823645:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823650:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823657:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823662:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947500.823665:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823671:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823679:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:1.0:1783947500.823682:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947500.823684:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823690:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823764:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f9d expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823781:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f9d expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.823797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:1.0:1783947500.823799:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783947500.823802:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55800, rc 0) 00000100:00100000:1.0:1783947500.825669:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+32:11331:x1870604213997824:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 6212us (13807us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1783947500.825682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 103 00000100:00100000:2.0:1783947500.843355:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947500.843665:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213997952 00000100:00100000:0.0:1783947500.843676:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213997952 00000100:00100000:0.0:1783947500.843750:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 104 00000100:00100000:0.0:1783947500.843761:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+32:11331:x1870604213997952:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:0.0:1783947500.843856:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.843876:0:8291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 32 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.843887:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.843926:0:8291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 32 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947500.843941:0:8291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 32 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947500.843957:0:8291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236097152:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947500.844072:0:8291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947500.849844:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.849986:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213998208 00000100:00100000:1.0:1783947500.849995:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213998208 00000100:00100000:1.0:1783947500.850055:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1783947500.850065:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+33:6644:x1870604213998208:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947500.850604:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+34:6644:x1870604213998208:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 539us (768us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1783947500.850613:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:0.0:1783947500.852278:0:8291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e43100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236097152:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947500.852307:0:8291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.857833:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947500.858573:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213998336 00000100:00100000:1.0:1783947500.858591:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213998336 00010000:00010000:1.0:1783947500.858655:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 34 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947500.858721:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:1.0:1783947500.858742:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+34:2406:x1870604213998336:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947500.858762:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947500.858772:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 34 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.858788:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 34 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.858836:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb5550081c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f81 expref: 34 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.858888:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:1.0:1783947500.858896:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.859418:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.859666:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947500.859741:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947500.859832:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+33:2406:x1870604213998336:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1089us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947500.859842:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00010000:00010000:3.0:1783947500.861581:0:8291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861599:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861656:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861663:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861671:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861677:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ac00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947500.861683:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861691:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861714:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:3.0:1783947500.861717:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947500.861722:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947500.861758:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500885 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947500.861883:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+32:11331:x1870604213997952:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 18113us (18526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947500.861895:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 104 00000100:00100000:3.0:1783947500.866815:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947500.871514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213998592 00000100:00100000:2.0:1783947500.871540:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213998592 00000100:00100000:2.0:1783947500.871644:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:2.0:1783947500.871657:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+32:11331:x1870604213998592:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1783947500.872051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+33:11331:x1870604213998592:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 395us (5253us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783947500.872060:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:2.0:1783947500.998863:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.000311:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213998848 00000100:00100000:3.0:1783947501.000331:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213998848 00000100:00100000:2.0:1783947501.003658:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:2.0:1783947501.003700:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+33:11342:x1870604213998848:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:2.0:1783947501.003753:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947501.003784:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb5550088c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fa4 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.003900:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.003919:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.003934:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.003950:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.003958:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.003964:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004134:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555008a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004146:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555008a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004153:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555008a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947501.004185:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1783947501.004429:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004438:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004445:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004452:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947501.004493:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004502:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004516:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:2.0:1783947501.004520:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947501.004526:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004532:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500893 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004548:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004554:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004571:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004576:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ee00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947501.004579:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004585:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004592:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bc5593000) 00010000:00010000:2.0:1783947501.004594:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947501.004597:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004603:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550089a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004668:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb5550088c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fa4 expref: 36 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004684:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555008a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fa4 expref: 35 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.004692:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:2.0:1783947501.004694:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947501.004698:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947501.004824:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+35:11342:x1870604213998848:12345-192.168.204.3@tcp:101:cat.0 Request processed in 1151us (5989us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1783947501.004844:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00080000:1.0:1783947501.010581:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947501.017134:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.017489:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213999104 00000100:00100000:0.0:1783947501.017504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213999104 00000100:00100000:0.0:1783947501.017576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:0.0:1783947501.017587:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+35:11342:x1870604213999104:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:0.0:1783947501.018193:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+36:11342:x1870604213999104:12345-192.168.204.3@tcp:35:cat.0 Request processed in 604us (1071us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1783947501.018362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:0.0:1783947501.054504:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.054677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213999360 00000100:00100000:1.0:1783947501.054701:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213999360 00000100:00100000:1.0:1783947501.054799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:1.0:1783947501.054812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+36:11343:x1870604213999360:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:1.0:1783947501.055199:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1783947501.055251:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb5550083f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f8f expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055283:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb555008a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fa4 expref: 35 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055321:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500877 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f9d expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055333:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500831 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f88 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055343:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:1.0:1783947501.055350:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947501.055383:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055651:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055665:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055687:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055693:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055699:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055821:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055831:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.055922:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947501.056642:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1783947501.056655:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386284197180ns, next at 387284193930ns, rc = 0 00010000:00010000:1.0:1783947501.056746:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.056759:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.056769:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.056777:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.056784:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.056791:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.056812:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947501.056845:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057385:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057393:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057532:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947501.057538:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057548:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057566:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:1.0:1783947501.057569:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783947501.057575:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057582:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555008bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057611:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057616:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057623:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057627:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947501.057630:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057635:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057657:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947501.057659:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947501.057662:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.057668:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb555008af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947501.057680:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd9af033 reply state 000000006a709d24 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.058154:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947501.058165:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.058173:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947501.058177:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.058184:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.058195:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:0.0:1783947501.058198:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783947501.058201:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.058219:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555008c4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.058236:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947501.058239:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947501.058242:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947501.058393:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.059826:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:1.0:1783947501.059837:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947501.059843:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947501.060182:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+34:11343:x1870604213999360:12345-192.168.204.3@tcp:36:rm.0 Request processed in 5364us (5735us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1783947501.060194:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:1.0:1783947501.152391:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.152712:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213999616 00000100:00100000:3.0:1783947501.152734:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213999616 00000100:00100000:3.0:1783947501.152823:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 107 00000100:00100000:3.0:1783947501.152836:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+34:11349:x1870604213999616:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947501.152880:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947501.152916:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555008cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fab expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.153294:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.153316:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.153329:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.153342:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.153373:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.153382:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947501.153957:0:8291:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783947501.164262:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164305:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164322:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164383:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164393:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164400:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164407:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947501.164413:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164424:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164442:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:2.0:1783947501.164447:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947501.164453:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164497:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555008d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947501.164546:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7d81361 reply state 00000000e5ae67cb transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164561:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164568:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:2.0:1783947501.164570:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947501.164576:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783947501.164633:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555008cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 37 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164654:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 36 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.164663:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593000) 00010000:00010000:2.0:1783947501.164665:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947501.164668:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ee00, rc 0) 00000100:00100000:2.0:1783947501.166518:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+37:11349:x1870604213999616:12345-192.168.204.3@tcp:101:bash.0 Request processed in 13658us (14118us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783947501.166536:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 107 00000100:00100000:2.0:1783947501.187765:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.187992:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213999744 00000100:00100000:3.0:1783947501.188007:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213999744 00000100:00100000:3.0:1783947501.188135:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:3.0:1783947501.188149:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604213999744:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947501.188176:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947501.188216:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fb2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947501.188250:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947501.188276:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1783947501.188281:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947501.188293:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.188317:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.188334:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50000, rc 0) 00000100:00100000:3.0:1783947501.189276:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604213999744:12345-192.168.204.3@tcp:101:bash.0 Request processed in 1119us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.189309:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:0.0:1783947501.200063:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.200711:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604213999872 00000100:00100000:2.0:1783947501.200740:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604213999872 00000100:00100000:2.0:1783947501.200827:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:2.0:1783947501.200841:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+8:11349:x1870604213999872:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947501.201130:0:10351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947501.201174:0:10351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fb9 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.201748:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.201763:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947501.201768:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947501.201775:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 9 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.201825:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.202312:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 9 pid: 8429 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.202964:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10351:1870604236097280:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947501.205320:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947501.211024:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.211825:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214000000 00000100:00100000:2.0:1783947501.211852:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214000000 00010000:00010000:2.0:1783947501.211930:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 10 pid: 8429 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.212003:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:2.0:1783947501.212015:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+10:2406:x1870604214000000:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947501.212036:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947501.212086:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 10 pid: 8429 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.212101:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 10 pid: 8429 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.212137:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947501.212142:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947501.212153:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 10 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.212164:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 10 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.213032:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 10 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.213060:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f99500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1870604236097408:192.168.204.3@tcp:105: 00000100:00100000:2.0:1783947501.213183:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd180 going to sleep for 11 seconds 00010000:00010000:0.0:1783947501.213519:0:10351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb555008ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb2 expref: 10 pid: 8429 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947501.213543:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10351:1870604236097280:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947501.213595:0:10351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 9 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.213609:0:10351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f400, rc 0) 00000100:00100000:0.0:1783947501.213648:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+9:11349:x1870604213999872:12345-192.168.204.3@tcp:101:bash.0 Request processed in 12811us (13602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.213659:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:0.0:1783947501.218635:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f99500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6497:1870604236097408:192.168.204.3@tcp:105: 00010000:00010000:0.0:1783947501.218682:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947501.218772:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214000000:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 6756us (7761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.218787:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:1.0:1783947501.227813:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.227973:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214000256 00000100:00100000:2.0:1783947501.227991:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214000256 00000100:00100000:2.0:1783947501.228085:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1783947501.228098:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+37:11349:x1870604214000256:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:2.0:1783947501.229341:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+38:11349:x1870604214000256:12345-192.168.204.3@tcp:35:bash.0 Request processed in 1237us (1544us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1783947501.229363:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:3.0:1783947501.299835:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947501.299876:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236097536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947501.299982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947501.300159:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236097536 00000100:00100000:2.0:1783947501.300170:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236097536 00000100:00100000:2.0:1783947501.300267:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783947501.300278:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870604236097536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947501.300321:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947501.300391:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1870604236097536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.300399:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783947501.300496:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236097536:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783947501.300792:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947501.301769:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236097792:0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.301863:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947501.301915:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236098304:0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.301938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947501.301961:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236098816:0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.302001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947501.302034:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783947501.302040:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236097664:0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.302069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947501.302090:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236098176:0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.302114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947501.302133:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236098688:0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.302159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947501.302198:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236097664 00000100:00100000:0.0:1783947501.302502:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236098048:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.302542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947501.302566:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236098560:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.302591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947501.302611:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236099072:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.302634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947501.302657:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783947501.302664:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236097920:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.302688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947501.302708:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236098432:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.302745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947501.302761:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236098944:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.302805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947501.302836:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098688 00000100:00100000:3.0:1783947501.303121:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098176 00000100:00100000:3.0:1783947501.303136:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098176 00000100:00100000:3.0:1783947501.303198:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236097920 00000100:00100000:2.0:1783947501.303507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783947501.303523:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236098176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947501.303620:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236098176:12345-0@lo:400:kworker.0 Request processed in 101us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.303628:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783947501.303670:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236097792 00000100:00100000:2.0:1783947501.303674:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236097792 00000100:00100000:2.0:1783947501.303698:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098304 00000100:00100000:2.0:1783947501.303701:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098304 00000100:00080000:2.0:1783947501.303740:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947501.303756:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098816 00000100:00100000:2.0:1783947501.303759:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098816 00000100:00080000:2.0:1783947501.303771:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947501.303782:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098048 00000100:00100000:2.0:1783947501.303784:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098048 00000100:00100000:2.0:1783947501.303794:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098432 00000100:00100000:2.0:1783947501.303797:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098432 00000100:00080000:2.0:1783947501.303806:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947501.303817:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098944 00000100:00100000:2.0:1783947501.303819:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098944 00000100:00100000:1.0:1783947501.303954:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236097664 00000100:00100000:1.0:1783947501.303994:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1783947501.304001:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236097664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.304048:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236097664:12345-0@lo:400:kworker.0 Request processed in 47us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.304053:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1783947501.304107:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236098560 00000100:00100000:1.0:1783947501.304112:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098560 00000100:00100000:1.0:1783947501.304145:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236099072 00000100:00100000:1.0:1783947501.304149:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236099072 00000100:00100000:1.0:1783947501.304177:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783947501.304184:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236098560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.305484:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236097920 00000100:00100000:3.0:1783947501.305566:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783947501.305576:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236097920:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783947501.305664:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947501.305673:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947501.305675:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947501.305730:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783947501.305740:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236097792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.305803:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236098688 00000100:00100000:0.0:1783947501.305862:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783947501.305870:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236099072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.309770:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236097920:12345-0@lo:400:kworker.0 Request processed in 4178us (7061us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.309792:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783947501.309914:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236097920:0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.309970:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783947501.309989:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236098688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.310063:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236098688:12345-0@lo:400:kworker.0 Request processed in 84us (7903us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.310069:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783947501.310100:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1783947501.310110:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236098304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.310150:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236098304:12345-0@lo:400:kworker.0 Request processed in 42us (8211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.310156:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1783947501.310198:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783947501.310206:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236098816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.310243:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236098816:12345-0@lo:400:kworker.0 Request processed in 38us (8240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.310249:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1783947501.310263:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1783947501.310270:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236098048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.310337:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236098048:12345-0@lo:400:kworker.0 Request processed in 67us (7794us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.310344:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1783947501.310443:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783947501.310452:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236098432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.310524:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236098432:12345-0@lo:400:kworker.0 Request processed in 73us (7778us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.310531:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783947501.310543:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1783947501.310550:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236098944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.310581:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236098944:12345-0@lo:400:kworker.0 Request processed in 33us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.310587:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:3.0:1783947501.310628:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01d09c00 x1870604236098432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947501.310642:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236098432:0@lo:400:kworker.0 00010000:00080000:3.0:1783947501.310657:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01d09f80 x1870604236098944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947501.310681:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236098944:0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.310698:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236098048:0@lo:400:kworker.0 00000100:00080000:3.0:1783947501.310771:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947501.311031:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236097792:12345-0@lo:400:kworker.0 Request processed in 5280us (9155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.311039:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783947501.311374:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236099072:12345-0@lo:400:kworker.0 Request processed in 5502us (8735us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.311383:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783947501.311454:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236097664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.311486:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236098176:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.311503:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236098688:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.311518:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236097792:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.311531:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236098304:0@lo:400:kworker.0 00000100:00100000:0.0:1783947501.311545:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236098816:0@lo:400:kworker.0 00000100:00100000:1.0:1783947501.312253:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236098560:12345-0@lo:400:kworker.0 Request processed in 8062us (9653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.312267:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783947501.318612:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236098560:0@lo:400:kworker.0 00000100:00100000:3.0:1783947501.318660:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236099072:0@lo:400:kworker.0 00000100:00100000:2.0:1783947501.437232:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.437770:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214000384 00000100:00100000:3.0:1783947501.437786:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214000384 00000100:00100000:3.0:1783947501.438009:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 108 00000100:00100000:3.0:1783947501.438022:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+38:11365:x1870604214000384:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947501.438058:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947501.438090:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555008fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fc0 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.438182:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500903 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.438211:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.438225:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947501.438280:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783947501.438284:0:12193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947501.438306:0:12193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.438511:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555008fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fc0 expref: 40 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.438538:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fc0 expref: 39 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.438548:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947501.438552:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947501.438557:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51e00, rc 0) 00000100:00100000:3.0:1783947501.440311:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+39:11365:x1870604214000384:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 626us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.440344:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 108 00000100:00100000:1.0:1783947501.446419:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.446536:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214000640 00000100:00100000:0.0:1783947501.446550:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214000640 00000100:00100000:0.0:1783947501.446633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 109 00000100:00100000:0.0:1783947501.446646:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+39:11365:x1870604214000640:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947501.446677:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947501.446705:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550090a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fc7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.446882:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.446923:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.446937:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947501.446954:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783947501.447099:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550090a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fc7 expref: 42 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.447122:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fc7 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.447131:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593000) 00010000:00010000:0.0:1783947501.447134:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947501.447139:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:0.0:1783947501.447222:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+41:11365:x1870604214000640:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 579us (820us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1783947501.447230:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 109 00000100:00100000:1.0:1783947501.455776:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.456036:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.456339:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214001024 00000100:00100000:0.0:1783947501.456361:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214001024 00000100:00100000:0.0:1783947501.456449:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1783947501.456496:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+41:2407:x1870604214001024:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947501.456520:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947501.456560:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fc7 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.456603:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593000) 00010000:00010000:0.0:1783947501.456609:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947501.456682:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+40:2407:x1870604214001024:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 223us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.456690:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947501.457124:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214000896 00000100:00100000:2.0:1783947501.457131:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214000896 00000100:00100000:2.0:1783947501.457223:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 110 00000100:00100000:2.0:1783947501.457232:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+40:11365:x1870604214000896:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947501.457263:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947501.457284:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550091f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.457436:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500926 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.457475:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.457490:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500926 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947501.457506:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783947501.457664:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb5550091f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fce expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.457702:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500926 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fce expref: 42 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.457711:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593000) 00010000:00010000:2.0:1783947501.457725:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783947501.457729:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e000, rc 0) 00000100:00100000:2.0:1783947501.457780:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+42:11365:x1870604214000896:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 549us (2023us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1783947501.457787:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 110 00000100:00100000:3.0:1783947501.463690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.463837:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214001152 00000100:00100000:1.0:1783947501.463859:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214001152 00000100:00100000:1.0:1783947501.463944:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:1.0:1783947501.464145:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+8:2409:x1870604214001152:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:1.0:1783947501.464247:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.464282:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 8 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.464293:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947501.464299:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947501.464304:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.464560:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 8 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.464589:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 8 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947501.464610:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1870604236099200:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947501.464835:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d480 going to sleep for 11 seconds 00000100:00100000:3.0:1783947501.480982:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.481393:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1870604236099200:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947501.481434:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.482701:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214001280 00000100:00100000:2.0:1783947501.482732:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214001280 00002000:00100000:2.0:1783947501.482808:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9e7c01d0aa00 x1870604214001280/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:292/0 lens 504/0 e 0 to 0 dl 1783947512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947501.482822:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7c01d0aa00 with x1870604214001280 ext(0->8) 00010000:00010000:2.0:1783947501.482834:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 9 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.482926:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 9 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947501.482935:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7c01d0aa00 00000100:00100000:2.0:1783947501.483150:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1783947501.483162:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1eb923ac-790a-478f-897e-124614dbce09+9:2407:x1870604214001280:12345-192.168.204.3@tcp:4:lfs.0 00000100:00100000:2.0:1783947501.484621:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1eb923ac-790a-478f-897e-124614dbce09+11:2407:x1870604214001280:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 1450us (3643us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783947501.484647:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00002000:00100000:2.0:1783947501.484659:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9e7c01d0aa00 x1870604214001280/t4294967303(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:292/0 lens 504/448 e 0 to 0 dl 1783947512 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947501.484670:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7c01d0aa00 with x1870604214001280 ext(0->8) 00010000:00010000:2.0:1783947501.484680:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 11 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.484697:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 11 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947501.484705:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7c01d0aa00 00000100:00100000:3.0:1783947501.497835:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.498061:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214001408 00000100:00100000:2.0:1783947501.498076:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214001408 00010000:00010000:2.0:1783947501.498137:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 11 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.498188:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:2.0:1783947501.498199:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+11:2409:x1870604214001408:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947501.498215:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783947501.498234:0:7462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783947501.498237:0:7462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783947500 00002000:00010000:2.0:1783947501.498240:0:7462:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783947500 00002000:00010000:2.0:1783947501.498247:0:7462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783947500 00002000:00010000:2.0:1783947501.498250:0:7462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783947501.498256:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 11 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.498602:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 11 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.498627:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076cb378d/0xe6fd1fdb555008f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fb9 expref: 11 pid: 10351 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.498644:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947501.498648:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947501.498654:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.498663:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.498748:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947501.498814:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+10:2409:x1870604214001408:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 616us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.498822:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00010000:00010000:1.0:1783947501.499868:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499883:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499909:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499917:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499925:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499931:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947501.499936:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499944:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499960:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.499986:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500934 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947501.500129:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+9:2409:x1870604214001152:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 36173us (36453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.500140:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:3.0:1783947501.505859:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.506398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214001664 00000100:00100000:2.0:1783947501.506416:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214001664 00000100:00100000:2.0:1783947501.506525:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:2.0:1783947501.506537:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+42:11365:x1870604214001664:12345-192.168.204.3@tcp:35:lfs.0 00000004:00010000:2.0:1783947501.506633:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500926 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fce expref: 42 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947501.506932:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1783947501.506965:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1783947501.507384:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1783947501.507447:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.507514:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 46 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.507525:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.507582:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 46 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.507602:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 46 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.507622:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1870604236099328:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947501.507765:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7a29300 going to sleep for 11 seconds 00000100:00100000:2.0:1783947501.511068:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1870604236099328:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947501.511113:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947501.513060:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.513188:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214001792 00000100:00100000:0.0:1783947501.513204:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214001792 00010000:00010000:0.0:1783947501.513259:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 47 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947501.513317:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:0.0:1783947501.513329:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+47:2407:x1870604214001792:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947501.513360:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947501.513370:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 47 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.513384:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 47 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.513416:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb555008e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fab expref: 47 pid: 8291 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.513452:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593000) 00010000:00010000:0.0:1783947501.513517:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.513550:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.513558:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.513597:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947501.513661:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+46:2407:x1870604214001792:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 334us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.513669:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00010000:00010000:3.0:1783947501.514001:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.514012:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947501.514182:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1783947501.514341:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1783947501.516295:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236099456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783947501.516980:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947501.517125:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947501.517920:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236099456 00000100:00100000:1.0:1783947501.517934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236099456 00000100:00100000:1.0:1783947501.518013:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783947501.518024:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6513:x1870604236099456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947501.518299:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6513:x1870604236099456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 275us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.518308:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783947501.525939:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236099456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783947501.533049:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1783947501.534884:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236099584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783947501.534989:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947501.535067:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947501.535271:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236099584 00000100:00100000:3.0:1783947501.535281:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236099584 00000100:00100000:3.0:1783947501.535367:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783947501.535379:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1870604236099584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783947501.535757:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6513:x1870604236099584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 379us (767us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783947501.535766:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783947501.537427:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236099584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783947501.537568:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1783947501.537647:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.537661:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.537670:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.537677:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947501.537682:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.537691:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.537725:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593000) 00010000:00010000:0.0:1783947501.537729:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783947501.537753:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.537760:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb5550093b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947501.539092:0:6513:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783947501.539185:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1783947501.539213:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386766755623ns, next at 387766752085ns, rc = 0 00000001:00080000:0.0:1783947501.539226:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1783947501.539284:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593000) 00010000:00010000:0.0:1783947501.539289:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783947501.539302:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500926 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fce expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947501.539510:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+49:11365:x1870604214001664:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 32973us (33678us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1783947501.539521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000020:00080000:0.0:1783947501.539528:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783947501.543922:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.544149:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214001920 00000100:00100000:2.0:1783947501.544165:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214001920 00000100:00100000:2.0:1783947501.544259:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 111 00000100:00100000:2.0:1783947501.544273:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+49:11365:x1870604214001920:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947501.544309:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947501.544342:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500942 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fd5 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.544636:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fd5 expref: 50 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.544655:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fd5 expref: 50 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.544681:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947501.544685:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947501.544689:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f000, rc 0) 00000100:00100000:2.0:1783947501.544879:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+50:11365:x1870604214001920:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 608us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.544888:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 111 00000100:00100000:1.0:1783947501.548791:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.548970:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214002176 00000100:00100000:2.0:1783947501.548983:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214002176 00000100:00100000:2.0:1783947501.549065:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1783947501.549079:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+50:11365:x1870604214002176:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:2.0:1783947501.549666:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+51:11365:x1870604214002176:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 585us (886us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1783947501.549697:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:1.0:1783947501.666995:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.667108:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214002304 00000100:00100000:0.0:1783947501.667122:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214002304 00000100:00100000:0.0:1783947501.667202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 112 00000100:00100000:0.0:1783947501.667215:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+51:11375:x1870604214002304:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:0.0:1783947501.667321:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667343:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667358:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667387:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667396:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667403:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667539:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667547:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667553:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947501.667620:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667635:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667642:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667651:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667657:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ac00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947501.667662:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667678:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667694:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947501.667697:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947501.667702:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667720:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500949 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667741:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667747:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667753:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667758:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947501.667761:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667766:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667772:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:0.0:1783947501.667775:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947501.667777:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667792:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500950 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667804:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667809:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667815:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667819:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947501.667822:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667826:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667834:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:0.0:1783947501.667836:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947501.667839:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.667845:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500957 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947501.667938:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+51:11375:x1870604214002304:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 724us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.667945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 112 00000100:00100000:1.0:1783947501.727863:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.728005:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214002560 00000100:00100000:2.0:1783947501.728019:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214002560 00000100:00100000:2.0:1783947501.728109:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 113 00000100:00100000:2.0:1783947501.728124:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+51:11378:x1870604214002560:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947501.728156:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947501.728189:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb5550095e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fdc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728314:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728335:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728349:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728361:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728369:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728376:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728575:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728608:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728615:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947501.728630:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783947501.728753:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728762:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728769:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728776:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947501.728781:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728791:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728808:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:2.0:1783947501.728812:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947501.728818:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728825:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500965 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728842:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728856:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728862:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728867:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ee00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947501.728871:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728877:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728885:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:2.0:1783947501.728888:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947501.728891:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728896:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb5550096c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728947:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb5550095e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728963:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.728972:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947501.728974:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947501.728982:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947501.729091:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+53:11378:x1870604214002560:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 970us (1260us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783947501.729099:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 113 00000100:00100000:1.0:1783947501.737983:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.738103:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214002688 00000100:00100000:2.0:1783947501.738120:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214002688 00000100:00100000:2.0:1783947501.738219:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:2.0:1783947501.738234:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+53:11378:x1870604214002688:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:2.0:1783947501.738345:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738371:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738388:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738444:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738453:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738500:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738507:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947501.738513:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738522:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738558:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947501.738561:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947501.738567:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.738575:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500981 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.738667:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+53:11378:x1870604214002688:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 437us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.738675:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:3.0:1783947501.746336:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.746514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214002944 00000100:00100000:0.0:1783947501.746529:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214002944 00000100:00100000:0.0:1783947501.746644:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:0.0:1783947501.746658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+53:11378:x1870604214002944:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947501.747018:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+54:11378:x1870604214002944:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 362us (696us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1783947501.747026:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00010000:00010000:0.0:1783947501.748087:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947501.816859:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947501.816892:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236099712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947501.816989:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947501.817236:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236099712 00000100:00100000:3.0:1783947501.817250:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236099712 00000100:00100000:3.0:1783947501.817327:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783947501.817340:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236099712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947501.817375:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947501.817453:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236099712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.817509:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783947501.817977:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236099712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947501.846178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.846340:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214003200 00000100:00100000:3.0:1783947501.846355:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214003200 00000100:00100000:3.0:1783947501.846443:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:3.0:1783947501.846487:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+54:11388:x1870604214003200:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947501.846527:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947501.846532:0:12193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947501.846574:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fc0 expref: 54 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.846624:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947501.846630:0:12193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947501.846649:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500988 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fe3 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.846810:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.846828:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.846848:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.846891:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.846906:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 54 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947501.846922:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236099840:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947501.847062:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947501.851858:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.851949:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214003328 00000100:00100000:1.0:1783947501.851961:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214003328 00010000:00010000:1.0:1783947501.852034:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 55 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947501.852086:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:1.0:1783947501.852095:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+55:2407:x1870604214003328:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947501.852116:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947501.852124:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 55 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.852140:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 55 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.852168:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:1.0:1783947501.852175:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.852188:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.852259:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.852286:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947501.852354:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+55:2407:x1870604214003328:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 259us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.852362:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00010000:00010000:3.0:1783947501.854905:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fdc expref: 54 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947501.854938:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236099840:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947501.854994:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.855006:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.855012:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947501.855039:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783947501.855331:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500988 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 55 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.855351:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 54 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.855362:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947501.855365:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947501.855370:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50000, rc 0) 00000100:00100000:3.0:1783947501.857375:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+54:11388:x1870604214003200:12345-192.168.204.3@tcp:101:bash.0 Request processed in 10905us (11200us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783947501.857393:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:2.0:1783947501.861716:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.861980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214003456 00000100:00100000:1.0:1783947501.861997:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214003456 00000100:00100000:1.0:1783947501.862115:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:1.0:1783947501.862151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+54:11388:x1870604214003456:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947501.862186:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947501.862227:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb5550099d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fea expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.862274:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.862292:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.862306:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.862506:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb5550099d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 56 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.862526:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.862536:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:1.0:1783947501.862540:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947501.862545:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55e00, rc 0) 00000100:00100000:1.0:1783947501.862626:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+55:11388:x1870604214003456:12345-192.168.204.3@tcp:101:bash.0 Request processed in 478us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.862633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:3.0:1783947501.865337:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.866701:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214003712 00000100:00100000:2.0:1783947501.866730:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214003712 00000100:00100000:2.0:1783947501.866934:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:2.0:1783947501.866947:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+55:11388:x1870604214003712:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:2.0:1783947501.867327:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.867350:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.867364:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947501.867420:0:8291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1783947501.867446:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000344ef5e reply state 00000000f1ac4ff4 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.868127:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.868137:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947501.868140:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947501.868146:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947501.868314:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+58:11388:x1870604214003712:12345-192.168.204.3@tcp:36:bash.0 Request processed in 1366us (2987us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1783947501.868323:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 117 00000020:00080000:2.0:1783947501.868331:0:8291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947501.874124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.874293:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214003840 00000100:00100000:3.0:1783947501.874310:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214003840 00000100:00100000:3.0:1783947501.874387:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:3.0:1783947501.874399:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+58:11388:x1870604214003840:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947501.874433:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947501.874521:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ff1 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.874677:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.874697:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 59 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.874721:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.874776:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 59 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.874792:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 59 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947501.874811:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236099968:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947501.874926:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947501.877584:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.877653:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236099968:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947501.877686:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.877982:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214003968 00000100:00100000:2.0:1783947501.877992:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214003968 00010000:00010000:2.0:1783947501.878047:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 60 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.878101:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:2.0:1783947501.878112:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+60:2406:x1870604214003968:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947501.878132:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947501.878140:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 60 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.878154:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 60 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.878185:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb5550098f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fe3 expref: 60 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.878302:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947501.878308:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.878320:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.878330:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.878356:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947501.878662:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.878671:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947501.878772:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783947501.878778:0:12193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947501.878809:0:12193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.878863:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 60 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.878882:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 59 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.878890:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947501.878893:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947501.878896:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51800, rc 0) 00000100:00100000:3.0:1783947501.878945:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+59:11388:x1870604214003840:12345-192.168.204.3@tcp:101:bash.0 Request processed in 4547us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.878955:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:2.0:1783947501.879308:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+58:2406:x1870604214003968:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1194us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.879316:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:0.0:1783947501.888310:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.888651:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214004224 00000100:00100000:2.0:1783947501.888665:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214004224 00000100:00100000:2.0:1783947501.888778:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1783947501.888790:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+58:11388:x1870604214004224:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:2.0:1783947501.889121:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+59:11388:x1870604214004224:12345-192.168.204.3@tcp:35:bash.0 Request processed in 332us (826us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1783947501.889130:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1783947501.955770:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.955909:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214004352 00000100:00100000:0.0:1783947501.955923:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214004352 00000100:00100000:0.0:1783947501.956012:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:0.0:1783947501.956025:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+59:11394:x1870604214004352:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947501.956063:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947501.956093:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555009c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3ff8 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.956185:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555009c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.956216:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555009c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.956229:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555009c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947501.956300:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783947501.956305:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947501.956330:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555009c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.956383:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb555009c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff8 expref: 61 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.956411:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555009c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff8 expref: 60 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.956422:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:0.0:1783947501.956425:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947501.956429:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ac00, rc 0) 00000100:00100000:1.0:1783947501.958316:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+60:11394:x1870604214004352:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1161us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.958333:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:2.0:1783947501.963590:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947501.963844:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214004480 00000100:00100000:3.0:1783947501.963860:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214004480 00000100:00100000:3.0:1783947501.963953:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:3.0:1783947501.963967:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+60:11394:x1870604214004480:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947501.963998:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947501.964028:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555009ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e3fff expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964123:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964164:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964177:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964204:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964213:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964221:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964317:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964327:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964334:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947501.964391:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783947501.964396:0:12193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947501.964768:0:12193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964787:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964812:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964819:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964974:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964983:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947501.964989:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.964999:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965018:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947501.965022:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947501.965029:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965035:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb555009d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965057:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965064:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965071:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965084:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947501.965088:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965095:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965104:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:3.0:1783947501.965106:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947501.965109:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965115:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb555009dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965161:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555009ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 62 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965179:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 61 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.965200:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947501.965203:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947501.965205:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50c00, rc 0) 00000100:00100000:2.0:1783947501.966150:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+61:11394:x1870604214004480:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 2177us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.966164:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:0.0:1783947501.972791:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.975019:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214004736 00000100:00100000:1.0:1783947501.975046:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214004736 00000100:00100000:1.0:1783947501.975160:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:1.0:1783947501.975174:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+61:11394:x1870604214004736:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947501.975218:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947501.975251:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4006 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.975404:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.975424:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 62 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.975434:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 62 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.975444:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.975553:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 62 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.975570:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 62 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947501.975587:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d14380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236100096:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947501.975748:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 62 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.975777:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 62 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947501.975787:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d15500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236100224:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947501.975815:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947501.980842:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947501.981014:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214004864 00000100:00100000:2.0:1783947501.981027:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214004864 00010000:00010000:2.0:1783947501.981087:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 63 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947501.981142:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:2.0:1783947501.981155:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+63:2407:x1870604214004864:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947501.981174:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947501.981184:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 63 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.981213:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 63 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.981248:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947501.981255:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.981266:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947501.981273:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947501.981352:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+63:2407:x1870604214004864:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 199us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947501.981361:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00010000:00010000:1.0:1783947501.982280:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555009e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fff expref: 62 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947501.982311:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d14380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236100096:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947501.985298:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.985497:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d15500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236100224:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947501.985547:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947501.985712:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214004992 00000100:00100000:3.0:1783947501.985722:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214004992 00010000:00010000:3.0:1783947501.985770:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 62 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947501.985856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:3.0:1783947501.985869:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+62:2408:x1870604214004992:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947501.985895:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947501.985903:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 62 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.985916:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 62 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.985945:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555009b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff1 expref: 62 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.985964:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947501.985970:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.985982:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.985992:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947501.986032:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947501.986102:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+61:2408:x1870604214004992:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 235us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947501.986110:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00010000:00010000:1.0:1783947501.987502:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.987523:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947501.987554:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783947501.987785:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.987807:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.990901:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:1.0:1783947501.990907:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947501.990912:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55600, rc 0) 00000100:00100000:1.0:1783947501.991033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+61:11394:x1870604214004736:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 15854us (18251us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1783947501.991045:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:2.0:1783947501.995350:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947501.995668:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214005248 00000100:00100000:0.0:1783947501.995683:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214005248 00000100:00100000:0.0:1783947501.995785:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1783947501.995797:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+61:11394:x1870604214005248:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:0.0:1783947501.995820:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947501.995865:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500942 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fd5 expref: 61 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947501.995888:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:0.0:1783947501.995894:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947501.995967:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+60:11394:x1870604214005248:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 173us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947501.995975:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:0.0:1783947501.998620:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947501.998733:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214005376 00000100:00100000:1.0:1783947501.998747:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214005376 00000100:00100000:1.0:1783947501.998822:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:1.0:1783947501.998845:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+60:11394:x1870604214005376:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:1.0:1783947501.999027:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.999052:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947501.999068:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947501.999211:0:8291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1783947501.999328:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+60:11394:x1870604214005376:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 495us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947501.999336:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:1.0:1783947502.002964:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.003656:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214005504 00000100:00100000:2.0:1783947502.003673:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214005504 00000100:00100000:2.0:1783947502.003851:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:2.0:1783947502.003863:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+60:11394:x1870604214005504:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947502.003892:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947502.003923:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e400d expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.004007:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.004021:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 61 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.004047:0:12193:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.004063:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 61 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.004081:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947502.004084:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947502.004089:0:12193:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 61 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.004096:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ee00, rc 0) 00000100:00100000:2.0:1783947502.004178:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+61:11394:x1870604214005504:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 318us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.004195:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 123 00000040:00080000:2.0:1783947502.196217:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947502.196239:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947502.196297:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783947502.196311:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947502.196543:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac66d5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236100352:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947502.196799:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947502.204680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.204819:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214005632 00000100:00100000:3.0:1783947502.204848:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214005632 00000100:00100000:3.0:1783947502.204923:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:3.0:1783947502.204934:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214005632:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947502.204979:0:6512:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783947502.205123:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214005632:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 190us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.205131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:2.0:1783947502.205976:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac66d5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236100352:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947502.212413:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947502.212546:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214005760 00000100:00100000:0.0:1783947502.212589:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214005760 00000100:00100000:0.0:1783947502.212658:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:0.0:1783947502.212670:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+61:11395:x1870604214005760:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783947502.212778:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212800:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212814:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212830:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212837:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212844:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212873:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212883:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212889:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947502.212954:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783947502.212959:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947502.212983:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.212996:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213004:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213012:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213019:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.213023:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213031:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213046:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:0.0:1783947502.213054:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.213060:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213068:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500a0d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213086:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213094:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213886:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213911:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.213915:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213923:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213939:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9e7c003e5d00) 00010000:00010000:0.0:1783947502.213942:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.213946:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213952:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500a14 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213976:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213983:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213988:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.213994:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.213996:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.214003:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.214023:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:0.0:1783947502.214025:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.214029:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.214035:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500a1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947502.215817:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+61:11395:x1870604214005760:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 3130us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947502.215836:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:0.0:1783947502.221149:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.226989:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214006016 00000100:00100000:2.0:1783947502.227010:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214006016 00000100:00100000:2.0:1783947502.227635:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:2.0:1783947502.227653:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+61:11395:x1870604214006016:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947502.227685:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947502.227722:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500a22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4014 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.227881:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.227903:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.227917:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947502.227932:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783947502.229662:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229686:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229731:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229738:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947502.229744:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229753:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229775:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947502.229779:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947502.229785:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229793:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229951:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500a22 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4014 expref: 63 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229965:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:2.0:1783947502.229967:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947502.229972:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500a22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4014 expref: 63 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.229983:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f800, rc 0) 00000100:00100000:2.0:1783947502.230365:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214006016:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 2714us (9228us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1783947502.232589:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:1.0:1783947502.237168:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.237510:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214006144 00000100:00100000:3.0:1783947502.237526:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214006144 00000100:00100000:3.0:1783947502.237601:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:3.0:1783947502.237614:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214006144:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947502.237671:0:8291:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783947502.237850:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214006144:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 238us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.237859:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:0.0:1783947502.247356:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.247614:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214006400 00000100:00100000:2.0:1783947502.247630:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214006400 00000100:00100000:2.0:1783947502.247723:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:2.0:1783947502.247737:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214006400:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947502.247768:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947502.247772:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783947502.247812:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb555009c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ff8 expref: 62 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.247836:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:2.0:1783947502.247842:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947502.247859:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500a37 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e401b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947502.248410:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1783947502.249491:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500a3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.249512:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.249526:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.249606:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500a37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e401b expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.249655:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e401b expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.249665:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bfcb9f900) 00010000:00010000:3.0:1783947502.249668:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947502.249672:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51800, rc 0) 00000100:00100000:3.0:1783947502.249780:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+63:11395:x1870604214006400:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 2047us (2439us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1783947502.249791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:1.0:1783947502.259751:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.263227:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214006656 00000100:00100000:3.0:1783947502.263250:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214006656 00000100:00100000:3.0:1783947502.263359:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:3.0:1783947502.263373:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+63:11395:x1870604214006656:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947502.263471:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947502.263509:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500a3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e401b expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263534:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bfcb9f900) 00010000:00010000:3.0:1783947502.263547:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947502.263576:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263593:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263605:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263642:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263651:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263658:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263727:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263736:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263743:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263750:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947502.263755:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263764:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263773:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947502.263776:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947502.263780:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263787:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500a4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263806:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263812:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263819:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263825:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947502.263828:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263834:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263842:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd5572699 (ffff9e7bfcb9f500) 00010000:00010000:3.0:1783947502.263844:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947502.263847:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.263853:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a53 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd5572699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.264399:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214006656:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 1024us (4660us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947502.264409:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:1.0:1783947502.267792:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.267907:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214006784 00000100:00100000:2.0:1783947502.267921:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214006784 00000100:00100000:2.0:1783947502.270012:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00100000:2.0:1783947502.270040:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+62:11395:x1870604214006784:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947502.270069:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947502.270104:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4022 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.270152:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.270199:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.270215:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.270371:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500a5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 64 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.270393:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 63 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.270404:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:2.0:1783947502.270408:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947502.270412:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f000, rc 0) 00000100:00100000:2.0:1783947502.270520:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+63:11395:x1870604214006784:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 493us (2744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.270529:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 130 00000100:00100000:1.0:1783947502.275793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.275967:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214007040 00000100:00100000:3.0:1783947502.275981:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214007040 00000100:00100000:3.0:1783947502.276057:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:3.0:1783947502.276085:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+63:11395:x1870604214007040:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947502.276207:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.276229:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.276244:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947502.277125:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1783947502.277139:0:6510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387504681430ns, next at 388504678481ns, rc = 0 00000004:00010000:1.0:1783947502.277205:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f70ff424 reply state 00000000a1c42207 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.277225:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.277234:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:1.0:1783947502.277238:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783947502.277242:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947502.277563:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+65:11395:x1870604214007040:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 1475us (1780us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1783947502.277573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:0.0:1783947502.285178:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.287427:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214007168 00000100:00100000:3.0:1783947502.287449:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214007168 00000100:00100000:3.0:1783947502.287616:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:3.0:1783947502.287631:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+65:11395:x1870604214007168:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947502.287665:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947502.287695:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4029 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.287784:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 66 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.287802:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 66 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.287826:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:3.0:1783947502.287830:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947502.287834:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50e00, rc 0) 00000100:00100000:3.0:1783947502.287921:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+66:11395:x1870604214007168:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 294us (2758us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.287956:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:1.0:1783947502.310137:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.314840:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214007296 00000100:00100000:3.0:1783947502.314863:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214007296 00000100:00100000:2.0:1783947502.316638:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:2.0:1783947502.316656:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214007296:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783947502.318349:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+9:2407:x1870604214007296:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 1683us (8213us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783947502.318364:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00080000:3.0:1783947502.321402:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947502.339050:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.342034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214007552 00000100:00100000:3.0:1783947502.342058:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214007552 00000100:00100000:3.0:1783947502.342229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1783947502.342243:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+66:11395:x1870604214007552:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947502.342613:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+67:11395:x1870604214007552:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 372us (3578us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1783947502.342623:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:0.0:1783947502.345646:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947502.349177:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214007808 00000100:00100000:1.0:1783947502.349198:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214007808 00000100:00100000:1.0:1783947502.349372:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:1.0:1783947502.349386:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+67:11395:x1870604214007808:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783947502.349587:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+67:11395:x1870604214007808:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 204us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.349596:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:1.0:1783947502.353915:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947502.356468:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214007936 00000100:00100000:0.0:1783947502.356492:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214007936 00000100:00100000:0.0:1783947502.356600:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:0.0:1783947502.356613:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+67:11395:x1870604214007936:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947502.356643:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947502.356678:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500a76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4030 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.356812:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500a7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.356832:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.356875:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947502.357087:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947502.357115:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.357152:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500a76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4030 expref: 69 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.357178:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500a7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4030 expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.357188:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:0.0:1783947502.357192:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783947502.357196:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9bc00, rc 0) 00000100:00100000:0.0:1783947502.357355:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+68:11395:x1870604214007936:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 742us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947502.357364:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:3.0:1783947502.360625:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.360856:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214008064 00000100:00100000:2.0:1783947502.360870:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214008064 00000100:00100000:2.0:1783947502.361021:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:2.0:1783947502.361056:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604214008064:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947502.361082:0:10351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947502.361110:0:10351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4037 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947502.361145:0:10351:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e0ed, blocks: 0x0 00010000:00010000:2.0:1783947502.361173:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1783947502.361179:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947502.361202:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 10 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.361228:0:10351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 10 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.361245:0:10351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f400, rc 0) 00000100:00100000:2.0:1783947502.361447:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+10:2406:x1870604214008064:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 394us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.361497:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:1.0:1783947502.373594:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.373708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214008320 00000100:00100000:3.0:1783947502.373727:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214008320 00000100:00100000:3.0:1783947502.373794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:3.0:1783947502.373808:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+68:11395:x1870604214008320:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947502.373956:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+68:11395:x1870604214008320:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 153us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.373964:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:2.0:1783947502.403650:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947502.404162:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214008448 00000100:00100000:1.0:1783947502.404201:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214008448 00000100:00100000:1.0:1783947502.404302:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:1.0:1783947502.404316:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+10:11395:x1870604214008448:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947502.404342:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947502.404370:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e403e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.404418:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 11 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.404428:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947502.404434:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947502.404447:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.404547:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 11 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.404566:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 11 pid: 10351 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947502.404590:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1870604236100480:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947502.404778:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947502.413063:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1870604236100480:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947502.413122:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 11 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.413180:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55400, rc 0) 00000100:00100000:1.0:1783947502.413332:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+11:11395:x1870604214008448:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 9018us (9690us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.413345:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:2.0:1783947502.414531:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.417808:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214008576 00000100:00100000:3.0:1783947502.417824:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214008576 00010000:00010000:3.0:1783947502.418165:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 11 pid: 10351 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.418364:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:3.0:1783947502.418376:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+11:2407:x1870604214008576:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947502.418409:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947502.418432:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 11 pid: 10351 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.418447:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 11 pid: 10351 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.418501:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076cb378d/0xe6fd1fdb55500a84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4037 expref: 11 pid: 10351 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.418519:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947502.418523:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947502.418531:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.418540:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.418581:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 10 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.418596:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1870604236100608:192.168.204.3@tcp:105: 00000100:00100000:3.0:1783947502.418688:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947502.423631:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1870604236100608:192.168.204.3@tcp:105: 00010000:00010000:3.0:1783947502.423657:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947502.423850:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+10:2407:x1870604214008576:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 5475us (9327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.423860:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 74 00000100:00100000:0.0:1783947502.425448:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947502.425561:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214008704 00000100:00100000:1.0:1783947502.425571:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214008704 00002000:00100000:1.0:1783947502.425625:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9e7c01c7df80 x1870604214008704/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:293/0 lens 504/0 e 0 to 0 dl 1783947513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947502.425636:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7c01c7df80 with x1870604214008704 ext(0->12) 00002000:00010000:1.0:1783947502.425642:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7c01c7df80 00000100:00100000:1.0:1783947502.425732:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:1.0:1783947502.425742:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+10:2406:x1870604214008704:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783947502.427782:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+12:2406:x1870604214008704:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 2030us (2331us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783947502.427796:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00002000:00100000:1.0:1783947502.427807:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9e7c01c7df80 x1870604214008704/t4294967309(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:293/0 lens 504/448 e 0 to 0 dl 1783947513 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947502.427817:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7c01c7df80 with x1870604214008704 ext(0->12) 00002000:00010000:1.0:1783947502.427823:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7c01c7df80 00000100:00100000:1.0:1783947502.437732:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.437834:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214008832 00000100:00100000:2.0:1783947502.437845:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214008832 00000100:00100000:2.0:1783947502.437909:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:2.0:1783947502.437935:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+68:11395:x1870604214008832:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783947502.450026:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1783947502.450047:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1783947502.450101:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783947502.450148:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7be7a29c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783947502.450153:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bc7607000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7be7a29300 00000020:00080000:1.0:1783947502.450156:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bc7607200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac7590400 00000004:00080000:1.0:1783947502.450190:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783947502.450216:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7ac65cdd80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783947502.450219:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7ac6609000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac65cd840 00000020:00080000:1.0:1783947502.450222:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7ac6609b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac6460200 00000100:00100000:3.0:1783947502.450555:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947502.450578:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236100736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783947502.450645:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947502.450689:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236100864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783947502.450733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947502.451171:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451193:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451200:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451220:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.451224:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451233:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451249:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9e7bd555bb00) 00010000:00010000:0.0:1783947502.451252:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.451257:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451263:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500790 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451297:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451304:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451310:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451315:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.451318:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451324:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451343:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9e7c003e5500) 00010000:00010000:0.0:1783947502.451345:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.451349:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451354:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500838 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451370:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451375:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451381:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451386:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.451388:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451394:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451401:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:0.0:1783947502.451404:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.451406:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451412:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb555008b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451432:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451438:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451501:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451508:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.451511:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451517:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451526:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7bd555bc00) 00010000:00010000:0.0:1783947502.451528:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.451530:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451535:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb555008d9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451552:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451557:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451562:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451573:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.451576:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451582:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451591:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:0.0:1783947502.451593:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947502.451596:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451602:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb555009ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451614:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451620:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451626:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451630:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947502.451633:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451639:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451657:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:0.0:1783947502.451659:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783947502.451662:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.451667:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500a68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783947502.452120:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1783947502.452195:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1783947502.452212:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236100736 00000100:00100000:2.0:1783947502.452220:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236100736 00000100:00100000:2.0:1783947502.452268:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236100864 00000100:00100000:2.0:1783947502.452272:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236100864 00000100:00100000:2.0:1783947502.452297:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947502.452305:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236100736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783947502.452332:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1783947502.452354:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.452376:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.452384:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783947502.452389:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947502.452393:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.452418:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.452431:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 11 pid: 8539 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947502.452642:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947502.452655:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bef960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1870604236100864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783947502.452780:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783947502.452784:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783947501 00002000:00010000:1.0:1783947502.452786:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783947502.452788:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783947501 -> 1783947501 00002000:00010000:1.0:1783947502.452791:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1783947502.452854:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bef960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3639:x1870604236100864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (2120us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783947502.452862:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783947502.452941:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236100992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783947502.452981:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947502.453044:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236100992 00000100:00100000:3.0:1783947502.453049:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236100992 00000100:00100000:3.0:1783947502.453077:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947502.453083:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3640:x1870604236100992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783947502.453096:0:10351:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1783947502.453118:0:10351:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a54e0ec, atime: 0x6a54e0ec, ctime: 0x6a54e0ec, blocks: 0x8 00010000:00010000:3.0:1783947502.453124:0:10351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453135:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1783947502.453138:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947502.453143:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453155:0:10351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453164:0:10351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453193:0:10351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453210:0:10351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783947502.453317:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3640:x1870604236100992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 233us (335us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783947502.453323:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1783947502.453340:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947502.453345:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453352:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947502.453357:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453364:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453378:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453384:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb55500a99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.453401:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947502.453408:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947502.453410:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783947502.453438:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7ac7f9aa00/2, rc 0, transno 4294967305 00000100:00100000:2.0:1783947502.453717:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870604236101120:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947502.453785:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947502.453878:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+16:11395:x1870604214008832:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 15946us (16158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.453888:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:3.0:1783947502.454340:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236100992:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1783947502.454907:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7c01d0b100/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783947502.454916:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236100864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783947502.460308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947502.460362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.460649:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214008960 00000100:00100000:3.0:1783947502.460661:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214008960 00010000:00010000:3.0:1783947502.460715:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 12 pid: 8539 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.460764:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:3.0:1783947502.460774:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+12:2407:x1870604214008960:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947502.460789:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947502.460796:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 12 pid: 8539 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.460810:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 12 pid: 8539 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.460838:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947502.460842:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947502.460849:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.460859:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.460882:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947502.460944:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+12:2407:x1870604214008960:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 171us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.460952:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 75 00000100:00100000:3.0:1783947502.460979:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214009088 00000100:00100000:3.0:1783947502.460984:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214009088 00000100:00100000:3.0:1783947502.461011:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:3.0:1783947502.461017:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+12:2407:x1870604214009088:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1783947502.461916:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fae04d71/0xe6fd1fdb55500846 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f96 expref: 12 pid: 8539 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947502.461935:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870604236101120:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947502.461958:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.461968:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.461975:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.461985:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.461992:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.462027:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783947502.462201:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3637:x1870604236100736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9896us (11554us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783947502.462211:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1783947502.462421:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947502.462429:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.462438:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947502.462451:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.462504:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.462520:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.462527:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9fef45b/0xe6fd1fdb55500a92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.462552:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947502.462554:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947502.462555:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783947502.462832:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7c01d09f80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1783947502.462839:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236100736:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1783947502.464977:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1783947502.464989:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1783947502.465165:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604214009088:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 4142us (4798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947502.465184:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1783947502.470934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.471080:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214009344 00000100:00100000:3.0:1783947502.471091:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214009344 00000100:00100000:3.0:1783947502.471215:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:3.0:1783947502.471226:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+16:11395:x1870604214009344:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947502.471287:0:8291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947502.471317:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500a7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4030 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.471339:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:3.0:1783947502.471345:0:8291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947502.471386:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.471398:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.471407:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947502.471600:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fc7cd17 reply state 00000000ed2d6c76 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.471612:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.471618:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:3.0:1783947502.471620:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947502.471622:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947502.471727:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+17:11395:x1870604214009344:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 503us (801us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1783947502.471734:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:2.0:1783947502.487155:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947502.487313:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214009472 00000100:00100000:1.0:1783947502.487324:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214009472 00000100:00100000:1.0:1783947502.487402:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:1.0:1783947502.487412:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2406:x1870604214009472:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783947502.487857:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783947502.487861:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1783947501 -> 1783947500 00002000:00010000:1.0:1783947502.487864:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783947500 00002000:00010000:1.0:1783947502.487866:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783947501 -> 1783947500 00002000:00010000:1.0:1783947502.487882:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783947502.487949:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604214009472:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 539us (804us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783947502.487959:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:2.0:1783947502.490084:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947502.490189:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214009728 00000100:00100000:0.0:1783947502.490198:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214009728 00000100:00100000:0.0:1783947502.490258:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:0.0:1783947502.490269:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+17:11395:x1870604214009728:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783947502.490337:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.490765:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 17 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.490776:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.490812:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 17 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.490826:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 17 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947502.490838:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236101248:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947502.490938:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947502.497593:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.497893:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214009856 00000100:00100000:3.0:1783947502.497909:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214009856 00010000:00010000:3.0:1783947502.497982:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 18 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.498801:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:3.0:1783947502.498832:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+18:2406:x1870604214009856:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947502.498858:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947502.498870:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 18 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.498887:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 18 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.498916:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:3.0:1783947502.498940:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.498963:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.498972:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.498997:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947502.499085:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+18:2406:x1870604214009856:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 272us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.499094:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00010000:00010000:1.0:1783947502.501124:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500a61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4022 expref: 17 pid: 12193 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947502.501152:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236101248:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947502.501180:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501191:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501197:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501239:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501245:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501348:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501354:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947502.501359:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501367:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501401:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:1.0:1783947502.501404:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783947502.501408:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.501415:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500aa7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947502.501599:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+16:11395:x1870604214009728:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 11330us (11523us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783947502.501611:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:0.0:1783947502.523679:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.524601:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214009984 00000100:00100000:3.0:1783947502.524617:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214009984 00000100:00100000:3.0:1783947502.524714:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:3.0:1783947502.524726:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:2409:x1870604214009984:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783947502.524790:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.524818:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.524829:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947502.524835:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947502.524841:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.524890:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.524928:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 7 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.524949:0:8539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1870604236101376:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947502.527963:0:8539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc9451b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947502.533854:0:8539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1870604236101376:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947502.533900:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947502.536419:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.536771:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214010112 00000100:00100000:2.0:1783947502.536785:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214010112 00010000:00010000:2.0:1783947502.536844:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947502.536898:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:2.0:1783947502.536910:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214010112:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947502.536930:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947502.536966:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.536983:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.537049:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007efeff9f/0xe6fd1fdb55500a8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e403e expref: 8 pid: 8429 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.537071:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947502.537077:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947502.537083:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.538419:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.538646:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947502.538795:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214010112:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1882us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.538808:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00010000:00010000:3.0:1783947502.539332:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539347:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539385:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539394:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539403:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539410:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947502.539416:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539426:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539487:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.539497:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb55500aae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.539592:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604214009984:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 14866us (15929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.539603:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:0.0:1783947502.557331:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.557579:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214010368 00000100:00100000:2.0:1783947502.557593:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214010368 00000100:00100000:2.0:1783947502.557677:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:2.0:1783947502.557690:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+16:11395:x1870604214010368:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783947502.557817:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.557841:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.557852:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.557919:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.557936:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 16 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947502.557953:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236101504:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947502.558623:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947502.564368:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236101504:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947502.564416:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947502.565995:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.568767:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214010496 00000100:00100000:2.0:1783947502.568791:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214010496 00010000:00010000:2.0:1783947502.568864:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 17 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947502.568933:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1783947502.568945:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+17:2407:x1870604214010496:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947502.568967:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947502.568976:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 17 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.568992:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 17 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.569049:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb555009a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3fea expref: 17 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.569071:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947502.569077:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 16 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.569089:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.569099:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.569108:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.569154:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947502.569243:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+16:2407:x1870604214010496:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 299us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.569251:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 78 00010000:00010000:0.0:1783947502.569687:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.569706:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.569975:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.569991:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 16 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.570000:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.570045:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 16 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.570063:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 16 pid: 8291 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947502.570081:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236101632:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947502.570166:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947502.576025:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.576240:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214010624 00000100:00100000:3.0:1783947502.576254:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214010624 00010000:00010000:3.0:1783947502.576322:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 17 pid: 8291 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.576385:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:3.0:1783947502.576396:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+17:2407:x1870604214010624:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947502.576417:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947502.576438:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 17 pid: 8291 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947502.576764:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236101632:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947502.576784:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 17 pid: 8291 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.576800:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.576824:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500a6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4029 expref: 17 pid: 8291 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.577438:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:3.0:1783947502.577684:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.577706:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.577715:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.577944:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947502.578044:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+16:2407:x1870604214010624:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1644us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.578054:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 79 00010000:00010000:0.0:1783947502.579907:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.579930:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947502.580109:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1783947502.580406:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1783947502.580895:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1783947502.581023:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236101760:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783947502.581120:0:12193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947502.581172:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947502.581498:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236101760 00000100:00100000:1.0:1783947502.581508:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236101760 00000100:00100000:1.0:1783947502.581574:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783947502.581586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12193:x1870604236101760:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783947502.581722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12193:x1870604236101760:12345-0@lo:1000:mdt00_004.0 Request processed in 138us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.581731:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783947502.581957:0:12193:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783947502.581966:0:12193:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1783947502.581991:0:12193:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7c01d0b100, transno 4294967310 00000100:00100000:3.0:1783947502.582016:0:12193:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e7c01d09f80 x1870604236100736/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783947518 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947502.582032:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236101760:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1783947502.582216:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1783947502.582282:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236101888:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783947502.582323:0:12193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947502.582358:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236101888 00000100:00100000:3.0:1783947502.582362:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236101888 00000100:00100000:3.0:1783947502.582392:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783947502.582400:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12193:x1870604236101888:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783947502.582578:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:12193:x1870604236101888:12345-0@lo:1000:mdt00_004.0 Request processed in 178us (254us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783947502.582586:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783947502.582618:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947502.582639:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236101888:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783947502.582681:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582704:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582714:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582721:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947502.582727:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582737:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582759:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:3.0:1783947502.582762:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947502.582769:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582776:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500abc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582808:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.582815:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.583075:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.583089:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947502.583093:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.583099:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.583109:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947502.583112:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947502.583121:0:12193:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 19 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.583134:0:12193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 19 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.583144:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 19 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.583607:0:12193:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 19 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.583627:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236102016:192.168.204.3@tcp:105: 00000100:00100000:0.0:1783947502.584268:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7062480 going to sleep for 11 seconds 00000100:00100000:3.0:1783947502.591951:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236102016:192.168.204.3@tcp:105: 00010000:00010000:3.0:1783947502.591997:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592011:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb555009ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592079:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592097:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592113:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592125:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592131:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592137:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592143:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947502.592148:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592155:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592168:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947502.592171:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947502.592175:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592261:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500ac3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592280:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592286:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592292:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592297:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947502.592300:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592307:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592316:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947502.592319:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783947502.592322:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.592328:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500ab5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947502.592909:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+19:11395:x1870604214010368:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 35216us (35588us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1783947502.592923:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 139 00000020:00080000:3.0:1783947502.592931:0:12193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783947502.593169:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947502.593187:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947502.594040:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783947502.594055:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947502.594897:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947502.595282:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214010752 00000100:00100000:1.0:1783947502.595299:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214010752 00000100:00100000:1.0:1783947502.595379:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1783947502.595396:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+19:11394:x1870604214010752:12345-192.168.204.3@tcp:49:lfs.0 00000100:00100000:1.0:1783947502.595649:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+19:11394:x1870604214010752:12345-192.168.204.3@tcp:49:lfs.0 Request processed in 257us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.595659:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1783947502.607383:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.607575:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214011008 00000100:00100000:3.0:1783947502.607607:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214011008 00000100:00100000:3.0:1783947502.607879:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:3.0:1783947502.607893:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+19:11394:x1870604214011008:12345-192.168.204.3@tcp:58:lfs.0 00000040:00080000:3.0:1783947502.608133:0:8291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1783947502.608257:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+19:11394:x1870604214011008:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 368us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947502.608265:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:0.0:1783947502.612658:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.612778:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214011264 00000100:00100000:3.0:1783947502.612792:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214011264 00000100:00100000:3.0:1783947502.612873:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:3.0:1783947502.612884:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+19:11395:x1870604214011264:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783947502.613251:0:6514:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783947502.613296:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1783947502.613340:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.613365:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.613379:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.613388:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.613395:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.613401:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947502.613688:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783947502.613817:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+21:11395:x1870604214011264:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 932us (1172us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1783947502.613828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000020:00080000:3.0:1783947502.613835:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783947502.617639:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947502.617664:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.617679:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947502.617685:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.617707:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.617732:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:0.0:1783947502.617761:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783947502.617768:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.617774:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500aca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947502.617797:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947502.617799:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947502.617801:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947502.659111:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947502.659314:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214011392 00000100:00100000:1.0:1783947502.659328:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214011392 00000100:00100000:1.0:1783947502.659420:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:1.0:1783947502.659433:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+21:11398:x1870604214011392:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947502.659651:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947502.659800:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55500ad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4045 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.659897:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.659916:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.659930:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.659949:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.659956:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.659963:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.660061:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.660073:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.660103:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.660149:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.660166:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 22 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947502.660573:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7128000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236102144:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947502.660912:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947502.669663:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7128000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236102144:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947502.669722:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947502.669884:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947502.669981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214011648 00000100:00100000:3.0:1783947502.669992:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214011648 00000100:00100000:3.0:1783947502.670065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1783947502.670078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+23:6177:x1870604214011648:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783947502.670396:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+24:6177:x1870604214011648:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 319us (512us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1783947502.670405:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:0.0:1783947502.678656:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947502.682892:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214011776 00000100:00100000:2.0:1783947502.682920:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214011776 00010000:00010000:2.0:1783947502.683000:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947502.683059:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:2.0:1783947502.683073:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+24:2406:x1870604214011776:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947502.683093:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947502.683101:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.683117:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.683148:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555009f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4006 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.683185:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947502.683191:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.683204:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.683214:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947502.683258:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947502.683619:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+23:2406:x1870604214011776:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 546us (4977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947502.683650:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 80 00010000:00010000:1.0:1783947502.683854:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.683864:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947502.683930:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783947502.683935:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947502.683959:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.683976:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.683987:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684006:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684013:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684021:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947502.684026:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684035:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684048:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:1.0:1783947502.684051:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947502.684055:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684062:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500ad8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684075:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684081:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684086:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684091:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947502.684101:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684107:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684115:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9e7be782f300) 00010000:00010000:1.0:1783947502.684118:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947502.684122:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684128:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500adf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684382:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55500ad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4045 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684400:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4045 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947502.684408:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:1.0:1783947502.684411:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947502.684413:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54a00, rc 0) 00000100:00100000:1.0:1783947502.684501:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+22:11398:x1870604214011392:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 25071us (25405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947502.684510:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00010000:00010000:0.0:1783947502.771828:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783947502.976125:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1783947502.976151:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1783947503.359074:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947503.359106:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236102272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947503.359214:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947503.359322:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236102272 00000100:00100000:0.0:1783947503.359332:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236102272 00000100:00100000:0.0:1783947503.359395:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783947503.359405:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236102272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947503.359481:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783947503.359539:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236102272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947503.359546:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783947503.359609:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236102272:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783947503.603708:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947503.603724:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947503.603769:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783947503.603782:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947503.604741:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7beeeeb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236102400:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947503.605217:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a8c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947503.614554:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7beeeeb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236102400:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783947503.614789:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947503.615019:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214011904 00000100:00100000:0.0:1783947503.615030:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214011904 00000100:00100000:0.0:1783947503.615114:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00080000:2.0:1783947503.615168:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947503.615246:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+22:11409:x1870604214011904:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783947503.615295:0:12193:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783947503.615529:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+22:11409:x1870604214011904:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 404us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947503.615538:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:0.0:1783947503.618946:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947503.619047:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214012160 00000100:00100000:2.0:1783947503.619060:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214012160 00000100:00100000:2.0:1783947503.619247:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:2.0:1783947503.619260:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+22:11409:x1870604214012160:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947503.619289:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947503.619316:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500aed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e404c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947503.619498:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500af4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947503.619517:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947503.619534:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947503.619548:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783947503.619709:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500aed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e404c expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947503.619749:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500af4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e404c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947503.619760:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:2.0:1783947503.619764:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947503.619768:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f400, rc 0) 00000100:00100000:2.0:1783947503.619977:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+24:11409:x1870604214012160:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 719us (1044us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1783947503.619986:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:2.0:1783947503.624296:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947503.624351:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947503.624453:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214012288 00000100:00100000:3.0:1783947503.624507:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214012288 00000100:00100000:3.0:1783947503.624592:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:3.0:1783947503.624606:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+24:2407:x1870604214012288:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947503.624630:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947503.624665:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500af4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e404c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947503.624701:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947503.624708:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947503.624783:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+23:2407:x1870604214012288:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 181us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947503.624825:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1783947503.625790:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214012544 00000100:00100000:1.0:1783947503.625809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214012544 00000100:00100000:1.0:1783947503.625875:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 144 00000100:00100000:1.0:1783947503.625896:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+23:11409:x1870604214012544:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783947503.626006:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626028:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626043:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626380:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626390:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626397:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626405:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947503.626410:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626419:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626655:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:1.0:1783947503.626659:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947503.626665:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947503.626887:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500b02 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947503.627110:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+24:11409:x1870604214012544:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 1213us (2825us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783947503.627118:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 144 00000040:00080000:3.0:1783947503.628568:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947503.628577:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947503.629264:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783947503.629282:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947503.639590:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947503.640562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214012800 00000100:00100000:3.0:1783947503.640578:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214012800 00000100:00100000:3.0:1783947503.640664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:3.0:1783947503.640687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+24:11409:x1870604214012800:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947503.641008:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+25:11409:x1870604214012800:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 333us (1433us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1783947503.641018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00010000:00010000:2.0:1783947503.801641:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947503.811944:0:14255:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947503.811960:0:14255:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947503.812003:0:14255:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783947503.812012:0:14255:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783947503.997738:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947503.999782:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013056 00000100:00100000:0.0:1783947504.001572:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013056 00000100:00100000:0.0:1783947504.001746:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:0.0:1783947504.001760:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+25:11422:x1870604214013056:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947504.001806:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947504.001837:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500b09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4053 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.001992:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500b10 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.002012:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500b10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.002026:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500b10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947504.002042:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783947504.002190:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9bc00/0xe6fd1fdb55500b09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4053 expref: 28 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.002230:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500b10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4053 expref: 27 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.002240:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:0.0:1783947504.002244:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783947504.002248:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ac00, rc 0) 00000100:00100000:0.0:1783947504.002352:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+27:11422:x1870604214013056:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 595us (4631us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783947504.002360:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:3.0:1783947504.007655:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947504.008259:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013184 00000100:00100000:0.0:1783947504.008274:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013184 00000100:00100000:0.0:1783947504.008348:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:0.0:1783947504.008360:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+27:11422:x1870604214013184:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:0.0:1783947504.008494:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008516:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008531:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008578:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008586:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008616:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008624:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947504.008629:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008639:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008657:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:0.0:1783947504.008661:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947504.008679:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.008688:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947504.008921:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+27:11422:x1870604214013184:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 561us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947504.008930:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:0.0:1783947504.126428:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947504.126496:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013312 00000100:00100000:0.0:1783947504.126509:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013312 00000100:00100000:0.0:1783947504.126602:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:0.0:1783947504.126614:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604214013312:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:0.0:1783947504.126641:0:10351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947504.126682:0:10351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079ce7076/0xe6fd1fdb55500b25 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e405a expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947504.126733:0:10351:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a54e0ec, atime: 0x6a54e0ec, ctime: 0x6a54e0ec, blocks: 0x8 00010000:00010000:0.0:1783947504.126763:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1783947504.126769:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947504.126781:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079ce7076/0xe6fd1fdb55500b25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e405a expref: 7 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.126805:0:10351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079ce7076/0xe6fd1fdb55500b25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e405a expref: 7 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947504.126821:0:10351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9bc00, rc 0) 00000100:00100000:0.0:1783947504.126894:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2409:x1870604214013312:12345-192.168.204.3@tcp:101:cat.0 Request processed in 283us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947504.126901:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00080000:2.0:1783947504.127941:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947504.132590:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947504.132642:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013440 00000100:00100000:2.0:1783947504.132655:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013440 00002000:00100000:2.0:1783947504.132735:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9e7bc4745180 x1870604214013440/t0(0) o3->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:295/0 lens 488/0 e 0 to 0 dl 1783947515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947504.132749:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7bc4745180 with x1870604214013440 ext(0->4095) 00002000:00010000:2.0:1783947504.132756:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7bc4745180 00000100:00100000:2.0:1783947504.132868:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1783947504.132881:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604214013440:12345-192.168.204.3@tcp:3:cat.0 00000100:00100000:2.0:1783947504.134018:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604214013440:12345-192.168.204.3@tcp:3:cat.0 Request processed in 1129us (1433us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783947504.134041:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00002000:00100000:2.0:1783947504.134055:0:8434:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9e7bc4745180 x1870604214013440/t0(0) o3->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:295/0 lens 488/4536 e 0 to 0 dl 1783947515 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783947504.134067:0:8434:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7bc4745180 with x1870604214013440 ext(0->4095) 00002000:00010000:2.0:1783947504.134072:0:8434:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7bc4745180 00010000:00010000:0.0:1783947504.819714:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947504.885766:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236102528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947504.885873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947504.891797:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236102528 00000100:00100000:0.0:1783947504.891815:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236102528 00000100:00100000:0.0:1783947504.891919:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783947504.891930:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236102528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947504.892129:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783947504.892314:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236102528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 386us (6444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947504.892324:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1783947504.892373:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947504.894051:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236102528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947504.894849:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236102656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947504.894933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947504.895021:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236102656 00000100:00100000:0.0:1783947504.895030:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236102656 00000100:00100000:0.0:1783947504.895096:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783947504.895108:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236102656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947504.895138:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783947504.895318:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236102656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 211us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947504.895326:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1783947504.895350:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947504.895383:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236102656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947505.125661:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947505.125782:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013568 00000100:00100000:3.0:1783947505.125796:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013568 00000100:00100000:3.0:1783947505.125876:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 380 00000100:00100000:3.0:1783947505.125888:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604214013568:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947505.125998:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604214013568:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 112us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947505.126006:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 380 00000100:00100000:1.0:1783947505.127569:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947505.127717:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947505.127751:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013696 00000100:00100000:1.0:1783947505.127760:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013696 00000100:00100000:1.0:1783947505.127839:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013824 00000100:00100000:1.0:1783947505.127843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013824 00000100:00100000:1.0:1783947505.127869:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 288 00000100:00100000:1.0:1783947505.127880:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+27:2408:x1870604214013696:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947505.128958:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 289 00000100:00100000:2.0:1783947505.128981:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214013824:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947505.129069:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214013824:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 97us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947505.129078:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 289 00000100:00080000:2.0:1783947505.129109:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947505.129114:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947505.129526:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+27:2408:x1870604214013696:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 87us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947505.129542:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 288 00000100:00100000:2.0:1783947505.138121:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947505.138161:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947505.138205:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947505.138233:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947505.138266:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214014208 00000100:00100000:2.0:1783947505.138277:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214014208 00000100:00100000:2.0:1783947505.138363:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214014336 00000100:00100000:2.0:1783947505.138366:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214014336 00000100:00100000:2.0:1783947505.138393:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:2.0:1783947505.138403:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214014208:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947505.138536:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214014208:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 134us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947505.138544:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 290 00000100:00100000:2.0:1783947505.138585:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00100000:2.0:1783947505.138592:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604214014336:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947505.138620:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604214014336:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947505.138627:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 291 00000100:00080000:2.0:1783947505.138668:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947505.138674:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947505.139397:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214013952 00000100:00100000:1.0:1783947505.139406:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214013952 00000100:00100000:1.0:1783947505.139486:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214014080 00000100:00100000:1.0:1783947505.139490:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214014080 00000100:00100000:1.0:1783947505.139529:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:1.0:1783947505.139538:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+7:2408:x1870604214013952:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947505.139597:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+7:2408:x1870604214013952:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 61us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947505.139605:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:1.0:1783947505.139621:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:1.0:1783947505.139627:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd8064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214014080:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947505.139685:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd8064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214014080:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 58us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947505.139692:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00080000:1.0:1783947505.139714:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947505.401985:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947505.402021:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236102784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947505.402128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947505.402216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236102784 00000100:00100000:2.0:1783947505.402226:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236102784 00000100:00100000:2.0:1783947505.402295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783947505.402306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236102784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947505.402377:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947505.402432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236102784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947505.402440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783947505.402532:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236102784:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947505.843851:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947506.421782:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236102912:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.421890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.421953:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236103424:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.421981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.421999:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236103936:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422038:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236104448:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422081:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783947506.422104:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236103040:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422414:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236103552:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422497:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236104064:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422566:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236103168:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422591:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422609:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236103680:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422657:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236104192:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422697:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783947506.422704:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236103296:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422856:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236103808:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422900:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236104320:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.422921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947506.422966:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236102912 00000100:00100000:0.0:1783947506.422976:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236102912 00000100:00100000:0.0:1783947506.423036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1783947506.423046:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236102912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.423104:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236102912:12345-0@lo:400:kworker.0 Request processed in 59us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947506.423123:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1783947506.423501:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103040 00000100:00100000:2.0:1783947506.423508:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103040 00000100:00100000:2.0:1783947506.423545:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103552 00000100:00100000:2.0:1783947506.423548:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103552 00000100:00100000:2.0:1783947506.423573:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104064 00000100:00100000:2.0:1783947506.423576:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104064 00000100:00100000:2.0:1783947506.423591:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783947506.423598:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236103040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947506.423666:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236103040:12345-0@lo:400:kworker.0 Request processed in 69us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947506.423674:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783947506.423690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103680 00000100:00100000:2.0:1783947506.423693:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103680 00000100:00100000:2.0:1783947506.423720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104192 00000100:00100000:2.0:1783947506.423723:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104192 00000100:00100000:2.0:1783947506.423748:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103296 00000100:00100000:2.0:1783947506.423751:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103296 00000100:00100000:0.0:1783947506.423956:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103424 00000100:00100000:0.0:1783947506.423961:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103424 00000100:00100000:0.0:1783947506.423989:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103168 00000100:00100000:0.0:1783947506.423997:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103168 00000100:00100000:0.0:1783947506.424012:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783947506.424017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236103424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.424053:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236103424:12345-0@lo:400:kworker.0 Request processed in 36us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947506.424059:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783947506.424072:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783947506.424079:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236103168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.424112:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236103168:12345-0@lo:400:kworker.0 Request processed in 33us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947506.424118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783947506.424138:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103936 00000100:00100000:0.0:1783947506.424143:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103936 00000100:00100000:2.0:1783947506.424233:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1783947506.424241:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236103552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947506.424287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236103552:12345-0@lo:400:kworker.0 Request processed in 47us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947506.424292:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1783947506.424305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783947506.424311:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947506.424340:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236104064:12345-0@lo:400:kworker.0 Request processed in 29us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947506.424346:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783947506.424358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1783947506.424364:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236103680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947506.424513:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236103680:12345-0@lo:400:kworker.0 Request processed in 148us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947506.424520:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1783947506.424533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1783947506.424540:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236104192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947506.424583:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236104192:12345-0@lo:400:kworker.0 Request processed in 43us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947506.424590:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1783947506.424602:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1783947506.424608:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236103296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947506.424647:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236103296:12345-0@lo:400:kworker.0 Request processed in 38us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947506.424653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:2.0:1783947506.424715:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947506.424721:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947506.425402:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104448 00000100:00100000:0.0:1783947506.425410:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104448 00000100:00100000:0.0:1783947506.425427:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236103808 00000100:00100000:0.0:1783947506.425430:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236103808 00000100:00100000:0.0:1783947506.425444:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104320 00000100:00100000:0.0:1783947506.425447:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104320 00000100:00100000:0.0:1783947506.425483:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783947506.425492:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236103936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.425553:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236103936:12345-0@lo:400:kworker.0 Request processed in 64us (3529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947506.425560:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783947506.425590:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783947506.425596:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236104448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.425643:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236104448:12345-0@lo:400:kworker.0 Request processed in 47us (3584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947506.425648:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783947506.425658:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783947506.425663:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236103808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.425693:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236103808:12345-0@lo:400:kworker.0 Request processed in 30us (2811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947506.425710:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783947506.425732:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783947506.425738:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236104320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.425774:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac66d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236104320:12345-0@lo:400:kworker.0 Request processed in 36us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947506.425779:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1783947506.425837:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947506.425841:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947506.425889:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236103296:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.425904:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236103808:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.425915:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236104320:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.425929:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236103168:0@lo:400:kworker.0 00010000:00080000:0.0:1783947506.425946:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7f3a300 x1870604236103680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947506.425956:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236103680:0@lo:400:kworker.0 00010000:00080000:0.0:1783947506.425979:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7e1ce00 x1870604236104192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947506.425988:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236104192:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.426045:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236103040:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.426058:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236103552:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.426069:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236104064:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.426079:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236102912:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.426090:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236103424:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.426102:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236103936:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.426111:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1783947506.426118:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1783947506.426139:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7bd9352a00, transno 4294967302 00000004:00080000:0.0:1783947506.428824:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1783947506.428870:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7ac7f9aa00, transno 4294967305 00000100:00100000:0.0:1783947506.428888:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236104448:0@lo:400:kworker.0 00000100:00100000:0.0:1783947506.436103:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac640a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236104576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947506.436216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947506.436332:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104576 00000100:00100000:3.0:1783947506.436342:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104576 00000100:00100000:3.0:1783947506.436429:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783947506.436439:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236104576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947506.436498:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947506.442213:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236104576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5759us (5980us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947506.442235:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783947506.452947:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac640a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236104576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783947506.870154:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947506.933636:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947506.933670:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236104704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947506.933944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947506.934067:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104704 00000100:00100000:3.0:1783947506.934078:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104704 00000100:00100000:3.0:1783947506.934150:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783947506.934162:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236104704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947506.934194:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947506.934251:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac640a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236104704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947506.934258:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947506.934354:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236104704:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1783947507.062831:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783947507.763771:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947507.763784:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947507.763810:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783947507.763821:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783947507.891759:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783947507.962437:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1783947507.962497:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7bc9451c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1783947507.962503:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bf3f72d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bc9451cc0 00000020:00080000:2.0:1783947507.962507:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bf3f72f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac7e52800 00000020:00080000:2.0:1783947507.962540:0:6489:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1783947507.962561:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1783947507.962658:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1783947507.963367:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947507.963385:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947507.963396:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947507.963404:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947507.963411:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947507.963421:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947507.963446:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9e7bc5593500) 00010000:00010000:1.0:1783947507.963450:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947507.963483:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947507.963491:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500aa0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947507.964777:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1783947507.964794:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:0.0:1783947508.469507:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947508.469539:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236104832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947508.469634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947508.469733:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104832 00000100:00100000:1.0:1783947508.469746:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104832 00000100:00100000:1.0:1783947508.469834:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783947508.469845:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236104832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947508.469901:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783947508.469990:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236104832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947508.469999:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783947508.470606:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236104832:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783947508.922583:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947509.092822:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947509.093182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214014464 00000100:00100000:0.0:1783947509.093193:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214014464 00000100:00100000:0.0:1783947509.093343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00100000:0.0:1783947509.093356:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+13:11083:x1870604214014464:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783947509.093496:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+13:11083:x1870604214014464:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 143us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947509.093504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00080000:2.0:1783947509.095281:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947509.098674:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947509.109590:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214014592 00000100:00100000:1.0:1783947509.109606:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214014592 00000100:00100000:1.0:1783947509.109689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 148 00000100:00100000:1.0:1783947509.109700:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:11083:x1870604214014592:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783947509.109802:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:11083:x1870604214014592:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 104us (11138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947509.109821:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 148 00000100:00080000:3.0:1783947509.110425:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947509.114142:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947509.117805:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214014848 00000100:00100000:1.0:1783947509.117824:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214014848 00000100:00100000:1.0:1783947509.117907:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:1.0:1783947509.117916:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+13:11083:x1870604214014848:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783947509.118179:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+14:11083:x1870604214014848:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 262us (4050us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1783947509.118187:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:2.0:1783947509.446280:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947509.446416:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214014976 00000100:00100000:0.0:1783947509.446429:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214014976 00000100:00100000:0.0:1783947509.446581:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 149 00000100:00100000:0.0:1783947509.446593:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:11881:x1870604214014976:12345-192.168.204.3@tcp:101:lsof.0 00010000:00010000:0.0:1783947509.446625:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947509.446654:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4061 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947509.446758:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947509.446775:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947509.446790:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947509.446855:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947509.446859:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947509.446907:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947509.446960:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 7 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947509.446985:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 6 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947509.446995:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:0.0:1783947509.446999:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947509.447003:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:0.0:1783947509.447102:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:11881:x1870604214014976:12345-192.168.204.3@tcp:101:lsof.0 Request processed in 512us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947509.447111:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 149 00000100:00080000:3.0:1783947509.447911:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783947509.942064:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947510.003726:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947510.003753:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236104960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947510.003840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947510.004191:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236104960 00000100:00100000:1.0:1783947510.004206:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236104960 00000100:00100000:0.0:1783947510.004313:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236105088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947510.004323:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783947510.004341:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236104960:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947510.004352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1783947510.004392:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783947510.004396:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105088 00000100:00100000:0.0:1783947510.004405:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105088 00000100:00100000:0.0:1783947510.004452:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783947510.004484:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236105088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947510.004508:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783947510.004538:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236104960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 202us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947510.004578:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783947510.004578:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236105088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947510.004592:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1783947510.004701:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947510.004837:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1783947510.004844:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7c01d09f80, transno 4294967311 00000004:00080000:1.0:1783947510.004866:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1783947510.004906:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236105088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947510.004925:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236104960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947510.248609:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947510.248995:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947510.249050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947510.249091:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947510.249124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947510.249158:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947510.249257:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214015616 00000100:00100000:0.0:1783947510.249271:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214015488 00000100:00100000:2.0:1783947510.249272:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214015616 00000100:00100000:0.0:1783947510.249286:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214015488 00000100:00100000:3.0:1783947510.249321:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214015360 00000100:00100000:3.0:1783947510.249328:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214015360 00000100:00100000:3.0:1783947510.249427:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214015872 00000100:00100000:3.0:1783947510.249450:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214015872 00000100:00100000:3.0:1783947510.249526:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214015232 00000100:00100000:3.0:1783947510.249529:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214015232 00000100:00100000:3.0:1783947510.249557:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 298 00000100:00100000:3.0:1783947510.249569:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214015360:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947510.250443:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214015360:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 871us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947510.250574:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214015104 00000100:00100000:1.0:1783947510.250582:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214015104 00000100:00100000:1.0:1783947510.250641:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 382 00000100:00100000:1.0:1783947510.250651:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604214015104:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947510.250690:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604214015104:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 41us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947510.250697:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 382 00000100:00100000:3.0:1783947510.250845:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 298 00000100:00100000:1.0:1783947510.250893:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 299 00000100:00100000:1.0:1783947510.250903:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214015872:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947510.250937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214015872:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 37us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947510.250946:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 299 00000100:00100000:1.0:1783947510.250963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 300 00000100:00100000:1.0:1783947510.250970:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+14:2407:x1870604214015232:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947510.251003:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+14:2407:x1870604214015232:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 34us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947510.251022:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 300 00000100:00100000:3.0:1783947510.251256:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947510.251395:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214015744 00000100:00100000:3.0:1783947510.251401:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214015744 00000100:00100000:3.0:1783947510.251431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 301 00000100:00100000:3.0:1783947510.251438:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214015744:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947510.251499:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214015744:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947510.251505:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 301 00000100:00080000:3.0:1783947510.251564:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947510.251572:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947510.251575:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947510.254712:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:2.0:1783947510.254745:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214015616:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947510.254862:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214015616:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 132us (5810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947510.254872:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:2.0:1783947510.254901:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:2.0:1783947510.254909:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604214015488:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947510.254939:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604214015488:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 31us (5779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947510.254945:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:3.0:1783947510.517055:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947510.517091:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236105216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947510.517188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947510.520847:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105216 00000100:00100000:2.0:1783947510.520866:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105216 00000100:00100000:2.0:1783947510.520955:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783947510.520977:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236105216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947510.521032:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947510.521362:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236105216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 393us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947510.521369:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783947510.523990:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236105216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947510.965752:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947511.541734:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236105600:0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.541838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947511.541911:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236106112:0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.541960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947511.542010:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236106112 00000100:00100000:3.0:1783947511.542024:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236106112 00000100:00100000:2.0:1783947511.542024:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236106624:0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947511.542092:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783947511.542104:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236106624 00000100:00100000:2.0:1783947511.542105:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236105472:0@lo:400:kworker.0 00000100:00100000:3.0:1783947511.542112:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236106624 00000100:00100000:2.0:1783947511.542148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947511.542157:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1783947511.542184:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236105856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947511.542186:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236106112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947511.542242:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236106496:0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947511.542286:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236107008:0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947511.542337:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236106496 00000100:00100000:2.0:1783947511.542344:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236106496 00000100:00100000:2.0:1783947511.542384:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236107008 00000100:00100000:2.0:1783947511.542387:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236107008 00000100:00100000:2.0:1783947511.542411:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947511.542419:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236106496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542536:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236106496:12345-0@lo:400:kworker.0 Request processed in 116us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.542544:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783947511.542564:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783947511.542571:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236107008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542615:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236107008:12345-0@lo:400:kworker.0 Request processed in 45us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.542622:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783947511.542669:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236106496:0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542680:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236107008:0@lo:400:kworker.0 00000100:00080000:2.0:1783947511.542737:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947511.542743:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947511.542754:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105472 00000100:00100000:2.0:1783947511.542757:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105472 00000100:00100000:2.0:1783947511.542778:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1783947511.542785:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236106624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542829:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1870604236106624:12345-0@lo:400:kworker.0 Request processed in 42us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.542837:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1783947511.542855:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1783947511.542862:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236105472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.542901:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236105472:12345-0@lo:400:kworker.0 Request processed in 40us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.542907:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1783947511.542937:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236105472:0@lo:400:kworker.0 00000100:00100000:3.0:1783947511.542951:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236106112:12345-0@lo:400:kworker.0 Request processed in 771us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.542956:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236106624:0@lo:400:kworker.0 00000100:00100000:3.0:1783947511.542972:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1783947511.542983:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236106112:0@lo:400:kworker.0 00000100:00100000:1.0:1783947511.543130:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105856 00000100:00100000:1.0:1783947511.543139:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105856 00000100:00100000:1.0:1783947511.543203:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783947511.543212:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236105856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947511.543236:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947511.543282:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236105856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947511.543288:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947511.543607:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105600 00000100:00100000:0.0:1783947511.543615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105600 00000100:00100000:0.0:1783947511.543673:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783947511.543682:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.543733:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236105600:12345-0@lo:400:kworker.0 Request processed in 53us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947511.543739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783947511.543768:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236105728:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.543804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947511.543857:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236106240:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.543882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947511.543898:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236106752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.543921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947511.543946:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1783947511.543953:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236105344:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.543993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947511.544030:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236105984:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.544065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947511.544073:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236105856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947511.544092:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236106368:0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.544116:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236105600:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.544124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947511.544155:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236106880:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.544179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947511.544217:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236106368 00000100:00100000:2.0:1783947511.544225:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236106368 00000100:00100000:0.0:1783947511.544228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105344 00000100:00100000:0.0:1783947511.544248:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105344 00000100:00100000:2.0:1783947511.544278:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236106880 00000100:00100000:2.0:1783947511.544285:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236106880 00000100:00100000:0.0:1783947511.544302:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1783947511.544313:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236105344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.544332:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783947511.544360:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf3f26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236105344:12345-0@lo:400:kworker.0 Request processed in 49us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947511.544368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1783947511.544406:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947511.544414:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236106880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.544443:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236106880:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947511.544449:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947511.544504:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105984 00000100:00100000:0.0:1783947511.544509:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105984 00000100:00100000:0.0:1783947511.544548:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783947511.544555:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236105984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.544586:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236105984:12345-0@lo:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947511.544591:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783947511.544621:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236105344:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.544630:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236105984:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.544638:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236106880:0@lo:400:kworker.0 00000100:00080000:0.0:1783947511.544696:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947511.544708:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236106368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947511.544940:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236106368:12345-0@lo:400:kworker.0 Request processed in 241us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947511.544948:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783947511.545295:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236105728 00000100:00100000:3.0:1783947511.545301:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236105728 00000100:00100000:3.0:1783947511.545407:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236106240 00000100:00100000:3.0:1783947511.545411:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236106240 00000100:00100000:3.0:1783947511.545440:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236106752 00000100:00100000:3.0:1783947511.545443:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236106752 00000100:00100000:3.0:1783947511.545479:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783947511.545486:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236105728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947511.545538:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236105728:12345-0@lo:400:kworker.0 Request processed in 53us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947511.545545:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783947511.545557:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783947511.545562:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236106240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947511.545844:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236106240:12345-0@lo:400:kworker.0 Request processed in 281us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947511.545851:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783947511.545864:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1783947511.545870:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236106752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947511.545897:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236106752:12345-0@lo:400:kworker.0 Request processed in 28us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947511.545902:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:3.0:1783947511.545923:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947511.546090:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236106368:0@lo:400:kworker.0 00000100:00100000:0.0:1783947511.546103:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236105728:0@lo:400:kworker.0 00010000:00080000:0.0:1783947511.546129:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01d15180 x1870604236106240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947511.546139:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236106240:0@lo:400:kworker.0 00010000:00080000:0.0:1783947511.546149:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7db3480 x1870604236106752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947511.546157:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236106752:0@lo:400:kworker.0 00010000:00010000:2.0:1783947511.987627:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947512.053722:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236107136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947512.053798:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947512.054375:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236107136 00000100:00100000:0.0:1783947512.054383:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236107136 00000100:00100000:0.0:1783947512.054438:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783947512.054447:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236107136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947512.054491:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947512.054552:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236107136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947512.054560:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783947512.054772:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236107136:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1783947512.908294:0:14453:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:58:30 (1783947510) 00010000:00010000:0.0:1783947513.011592:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947513.588203:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236107264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947513.588275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947513.589839:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236107264 00000100:00100000:1.0:1783947513.589851:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236107264 00000100:00100000:1.0:1783947513.589905:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783947513.589914:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236107264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947513.589953:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783947513.590099:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236107264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 185us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947513.590107:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783947513.590311:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236107264:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1783947513.590853:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1783947513.590862:0:6489:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1783947513.591819:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783947513.591833:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1783947514.008869:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947514.009271:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214016128 00000100:00100000:0.0:1783947514.009287:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214016128 00000100:00080000:3.0:1783947514.009503:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947514.010154:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:0.0:1783947514.010171:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+13:12148:x1870604214016128:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947514.010193:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947514.010216:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500b3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4068 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010307:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010322:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010335:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010350:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010357:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010364:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010492:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b4f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010501:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010508:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947514.010519:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783947514.010609:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010616:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010629:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010635:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947514.010639:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010647:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010660:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7bfcba0500) 00010000:00010000:0.0:1783947514.010664:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947514.010668:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010675:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500b41 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010691:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010697:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010703:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010708:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947514.010711:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010727:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010735:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e7c003e5700) 00010000:00010000:0.0:1783947514.010737:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947514.010740:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.010746:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500b48 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.012348:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500b3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4068 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.012373:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4068 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947514.012382:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:0.0:1783947514.012384:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947514.012388:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96400, rc 0) 00000100:00100000:0.0:1783947514.012648:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+15:12148:x1870604214016128:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 2483us (3793us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783947514.012658:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 150 00000100:00100000:2.0:1783947514.021940:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947514.022054:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947514.022151:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214016256 00000100:00100000:3.0:1783947514.022162:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214016256 00000100:00100000:3.0:1783947514.022226:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:3.0:1783947514.022235:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+15:12148:x1870604214016256:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783947514.022350:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+15:12148:x1870604214016256:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 114us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947514.022357:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:1.0:1783947514.022757:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214016384 00000100:00100000:1.0:1783947514.022763:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214016384 00000100:00100000:1.0:1783947514.023430:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:1.0:1783947514.023442:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+15:2406:x1870604214016384:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947514.023512:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947514.023541:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b4f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4068 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947514.023564:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:1.0:1783947514.023568:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947514.023619:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+14:2406:x1870604214016384:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 181us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947514.023640:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:2.0:1783947514.025859:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947514.026004:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214016512 00000100:00100000:3.0:1783947514.026014:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214016512 00000100:00100000:3.0:1783947514.026098:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00100000:3.0:1783947514.026107:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:12148:x1870604214016512:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783947514.026207:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+5:12148:x1870604214016512:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947514.026213:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00080000:2.0:1783947514.026619:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783947514.035679:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783947514.228332:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783947514.933890:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947514.933900:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947514.934402:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783947514.934412:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783947515.065023:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947515.124031:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947515.124056:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236107392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947515.124130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947515.124402:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236107520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947515.124436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947515.124606:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236107392 00000100:00100000:2.0:1783947515.124615:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236107392 00000100:00100000:2.0:1783947515.124673:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236107520 00000100:00100000:2.0:1783947515.124677:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236107520 00000100:00100000:2.0:1783947515.124696:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783947515.124704:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236107392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947515.124755:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783947515.124801:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236107392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947515.124809:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783947515.124826:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783947515.124831:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236107520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783947515.124842:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783947515.124869:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236107520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947515.124874:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783947515.124987:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236107392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783947515.125053:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947515.125079:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236107520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947515.374591:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947515.374628:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947515.374666:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947515.374713:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214017024 00000100:00100000:1.0:1783947515.374723:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214017024 00000100:00100000:3.0:1783947515.374729:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947515.375043:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214016768 00000100:00100000:0.0:1783947515.375048:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214016768 00000100:00100000:0.0:1783947515.375099:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214017280 00000100:00100000:0.0:1783947515.375113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214017280 00000100:00100000:1.0:1783947515.376551:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:1.0:1783947515.376576:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604214017024:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947515.376728:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 308 00000100:00100000:0.0:1783947515.376738:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+14:2409:x1870604214016768:12345-192.168.204.3@tcp:400:kworker.0 00000100:00080000:2.0:1783947515.378741:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947515.378752:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947515.378772:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214016640 00000100:00100000:2.0:1783947515.378781:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214016640 00000100:00100000:2.0:1783947515.378992:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 384 00000100:00100000:2.0:1783947515.379004:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604214016640:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947515.380315:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+6:2409:x1870604214017024:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3745us (5677us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947515.380328:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:0.0:1783947515.381254:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+14:2409:x1870604214016768:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 4509us (6665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947515.381271:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 308 00000100:00100000:0.0:1783947515.381307:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 309 00000100:00100000:0.0:1783947515.381324:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2409:x1870604214017280:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947515.381395:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2409:x1870604214017280:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 78us (6727us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947515.381396:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2409:x1870604214016640:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 2259us (6531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947515.381409:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 309 00000100:00100000:2.0:1783947515.381414:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 384 00000100:00100000:1.0:1783947515.381652:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947515.381736:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214016896 00000100:00100000:3.0:1783947515.381746:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214016896 00000100:00100000:1.0:1783947515.381750:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947515.381801:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947515.381891:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214017152 00000100:00100000:1.0:1783947515.381895:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214017152 00000100:00100000:1.0:1783947515.381933:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:1.0:1783947515.381941:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604214017152:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947515.381978:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604214017152:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947515.381984:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00080000:1.0:1783947515.382002:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947515.384919:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214017408 00000100:00100000:3.0:1783947515.385002:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214017408 00000100:00100000:3.0:1783947515.385086:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 310 00000100:00100000:3.0:1783947515.385097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604214016896:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947515.385858:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:2409:x1870604214016896:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 756us (4200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947515.385870:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 310 00000100:00100000:3.0:1783947515.385898:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 311 00000100:00100000:3.0:1783947515.385907:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604214017408:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947515.386029:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2409:x1870604214017408:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 123us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947515.386036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 311 00000100:00080000:0.0:1783947515.386273:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947515.635691:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947515.635723:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236107648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947515.635803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947515.635876:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236107648 00000100:00100000:3.0:1783947515.635884:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236107648 00000100:00100000:3.0:1783947515.635931:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783947515.635939:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236107648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947515.635974:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947515.636020:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236107648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947515.636028:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783947515.636088:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236107648:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783947516.086446:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947516.091829:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.092405:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214017536 00000100:00100000:0.0:1783947516.092416:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214017536 00000100:00100000:0.0:1783947516.092516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00100000:0.0:1783947516.092527:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+14:12190:x1870604214017536:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947516.092549:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947516.092572:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500b5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e406f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092642:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092658:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092679:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092696:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092704:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092711:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092760:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092768:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092775:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092781:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947516.092785:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092792:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092804:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:0.0:1783947516.092808:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.092812:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092825:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092839:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092845:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092851:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092856:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947516.092860:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092866:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092875:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e7c003e5700) 00010000:00010000:0.0:1783947516.092878:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.092880:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092886:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500b6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092921:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500b5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e406f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092945:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:0.0:1783947516.092947:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.092953:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500b5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e406f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.092964:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:0.0:1783947516.093098:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+14:12190:x1870604214017536:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 572us (1280us total) trans 0 rc 301/301 00000100:00100000:0.0:1783947516.093106:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 153 00000100:00080000:1.0:1783947516.095152:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947516.103637:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.103733:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214017792 00000100:00100000:1.0:1783947516.103744:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214017792 00000100:00100000:1.0:1783947516.103806:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 154 00000100:00100000:1.0:1783947516.103817:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+14:12190:x1870604214017792:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:1.0:1783947516.103874:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947516.103904:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb555004b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e93 expref: 14 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.103937:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:1.0:1783947516.103943:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947516.104019:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.104034:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 5 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.104044:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.104084:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 5 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.104100:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 5 pid: 8291 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947516.104116:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac77ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236107776:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947516.104215:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947516.116220:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.116344:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214017920 00000100:00100000:0.0:1783947516.116358:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214017920 00010000:00010000:0.0:1783947516.116516:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 6 pid: 8291 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947516.116567:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:0.0:1783947516.116583:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214017920:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947516.116604:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947516.116616:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 6 pid: 8291 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.116631:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 6 pid: 8291 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.116661:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:0.0:1783947516.116682:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.116694:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.116703:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.116730:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947516.117056:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214017920:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 476us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.117066:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 81 00010000:00010000:3.0:1783947516.118253:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500b33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4061 expref: 5 pid: 8291 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947516.118285:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac77ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1870604236107776:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947516.118394:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.118407:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.118413:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.118489:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.118503:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.118515:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120128:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120155:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120167:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947516.120199:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f5a41e1 reply state 0000000048254f0f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120213:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120222:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947516.120225:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947516.120230:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783947516.120238:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783947516.120248:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120255:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120262:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120269:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947516.120275:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120284:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120411:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb76400) 00010000:00010000:3.0:1783947516.120415:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947516.120419:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120446:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55500b72 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947516.120500:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f5a41e1 reply state 0000000048254f0f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120512:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.120520:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e7bc8a89200) 00010000:00010000:3.0:1783947516.120523:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947516.120526:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783947516.120808:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+15:12190:x1870604214017792:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 16986us (17176us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1783947516.120820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 154 00000100:00100000:0.0:1783947516.212011:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947516.212121:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214018048 00000100:00100000:2.0:1783947516.212132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214018048 00000100:00100000:2.0:1783947516.212192:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 155 00000100:00100000:2.0:1783947516.212201:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+15:12198:x1870604214018048:12345-192.168.204.3@tcp:101:lctl.0 00010000:00010000:2.0:1783947516.212226:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947516.212248:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4076 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.212327:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500b8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.212341:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.212354:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947516.212401:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947516.212404:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947516.212424:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.212622:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4076 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.212643:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500b8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4076 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.212651:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:2.0:1783947516.212654:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947516.212658:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f000, rc 0) 00000100:00100000:3.0:1783947516.213568:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+16:12198:x1870604214018048:12345-192.168.204.3@tcp:101:lctl.0 Request processed in 1359us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947516.213580:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 155 00000100:00100000:0.0:1783947516.271038:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947516.271297:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214018176 00000100:00100000:2.0:1783947516.271307:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214018176 00000100:00100000:2.0:1783947516.271376:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 156 00000100:00100000:2.0:1783947516.271387:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+16:12204:x1870604214018176:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947516.271410:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947516.271501:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500b95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e407d expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271582:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271599:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271611:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271622:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271630:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271637:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271728:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271737:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.271743:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947516.271777:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783947516.271781:0:12193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947516.271801:0:12193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273502:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273515:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273522:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273529:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947516.273534:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273551:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273571:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:2.0:1783947516.273574:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947516.273580:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273586:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273603:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273610:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273615:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273637:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947516.273640:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273646:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273654:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e7bc8a89200) 00010000:00010000:2.0:1783947516.273657:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947516.273660:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273666:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500ba3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273707:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500b95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e407d expref: 18 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273721:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500baa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e407d expref: 17 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.273727:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947516.273729:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783947516.273732:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f400, rc 0) 00000100:00100000:3.0:1783947516.277968:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+17:12204:x1870604214018176:12345-192.168.204.3@tcp:101:bash.0 Request processed in 6569us (6927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947516.277982:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 156 00000100:00100000:0.0:1783947516.285707:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947516.285952:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214018432 00000100:00100000:3.0:1783947516.285975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214018432 00000100:00100000:3.0:1783947516.286083:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 157 00000100:00100000:3.0:1783947516.286095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+17:12204:x1870604214018432:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947516.286124:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947516.286154:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500bb1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4084 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.286332:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.286354:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.286369:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.286610:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.286636:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.286651:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947516.287044:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1783947516.289701:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289722:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289733:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289772:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289795:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289802:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289809:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947516.289814:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289822:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289833:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947516.289836:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947516.289841:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289847:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500bb8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947516.289862:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001559d9cb reply state 0000000069866b43 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289873:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289878:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:3.0:1783947516.289880:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947516.289884:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783947516.289924:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500bb1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289949:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.289956:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89a00) 00010000:00010000:3.0:1783947516.289959:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947516.289961:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51600, rc 0) 00000100:00100000:3.0:1783947516.290033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+20:12204:x1870604214018432:12345-192.168.204.3@tcp:101:bash.0 Request processed in 3941us (4343us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1783947516.290042:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 157 00000100:00100000:1.0:1783947516.310308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947516.311026:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214018560 00000100:00100000:2.0:1783947516.311038:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214018560 00000100:00100000:2.0:1783947516.311112:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:2.0:1783947516.311122:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214018560:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947516.311152:0:10351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947516.311175:0:10351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e408b expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947516.311202:0:10351:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947516.311224:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:2.0:1783947516.311229:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947516.311240:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 6 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.311260:0:10351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 6 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.311274:0:10351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e000, rc 0) 00000100:00100000:2.0:1783947516.311339:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac77ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+6:2408:x1870604214018560:12345-192.168.204.3@tcp:101:bash.0 Request processed in 219us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.311347:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:0.0:1783947516.325044:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.325211:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214018688 00000100:00100000:1.0:1783947516.325220:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214018688 00000100:00100000:1.0:1783947516.325283:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:1.0:1783947516.325292:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+6:12204:x1870604214018688:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947516.325309:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947516.325328:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4092 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.325358:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 7 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.325368:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947516.325373:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947516.325379:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.325446:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 7 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.325508:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 7 pid: 10351 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947516.325523:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1870604236107904:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947516.325623:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1df00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947516.329120:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1870604236107904:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947516.329159:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.329199:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55600, rc 0) 00000100:00100000:3.0:1783947516.329267:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.329282:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+7:12204:x1870604214018688:12345-192.168.204.3@tcp:101:bash.0 Request processed in 3988us (4245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947516.329293:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:2.0:1783947516.339762:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214018816 00000100:00100000:2.0:1783947516.339785:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214018816 00010000:00010000:2.0:1783947516.340343:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 7 pid: 10351 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947516.340408:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:2.0:1783947516.340421:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214018816:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947516.340484:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947516.340515:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 7 pid: 10351 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.341950:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 7 pid: 10351 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.342181:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a820d56/0xe6fd1fdb55500bd4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e408b expref: 7 pid: 10351 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.342202:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947516.342207:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947516.342216:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.342227:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.342290:0:9516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947516.342309:0:9516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9516:1870604236108032:192.168.204.3@tcp:105: 00000100:00100000:2.0:1783947516.342436:0:9516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a62cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947516.354920:0:9516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9516:1870604236108032:192.168.204.3@tcp:105: 00010000:00010000:2.0:1783947516.354966:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947516.355178:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604214018816:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 14757us (25918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.355191:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 82 00000100:00100000:0.0:1783947516.356539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.356667:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214019072 00000100:00100000:1.0:1783947516.356678:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214019072 00000100:00100000:1.0:1783947516.356781:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:1.0:1783947516.356792:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+20:12204:x1870604214019072:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:1.0:1783947516.357125:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+21:12204:x1870604214019072:12345-192.168.204.3@tcp:35:bash.0 Request processed in 335us (596us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783947516.357134:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:1.0:1783947516.483950:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947516.484142:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214019328 00000100:00100000:3.0:1783947516.484153:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214019328 00000100:00100000:3.0:1783947516.484225:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 158 00000100:00100000:3.0:1783947516.484236:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+21:12214:x1870604214019328:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947516.484261:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947516.484283:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4099 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947516.484388:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783947516.484579:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500be2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4099 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.484596:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:3.0:1783947516.484600:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947516.484606:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4099 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.484640:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51200, rc 0) 00000100:00100000:3.0:1783947516.484698:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+22:12214:x1870604214019328:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 463us (757us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1783947516.484706:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 158 00000100:00100000:0.0:1783947516.488562:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.490322:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214019584 00000100:00100000:1.0:1783947516.490336:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214019584 00000100:00100000:0.0:1783947516.490643:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:0.0:1783947516.490655:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+22:12214:x1870604214019584:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947516.490946:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+23:12214:x1870604214019584:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 292us (2393us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1783947516.490962:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:0.0:1783947516.585788:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947516.587273:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214019712 00000100:00100000:2.0:1783947516.587288:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214019712 00000100:00100000:2.0:1783947516.587372:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:2.0:1783947516.587383:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+23:12220:x1870604214019712:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947516.587411:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947516.587444:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40a0 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.587567:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500bf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.587583:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.587596:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947516.587644:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783947516.587649:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947516.587670:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.587700:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40a0 expref: 25 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.587723:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40a0 expref: 24 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.587733:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947516.587737:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947516.587759:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f800, rc 0) 00000100:00100000:2.0:1783947516.589280:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+24:12220:x1870604214019712:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1888us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.589292:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:1.0:1783947516.604382:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947516.604499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214019968 00000100:00100000:3.0:1783947516.604509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214019968 00000100:00100000:3.0:1783947516.604579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:3.0:1783947516.604590:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+24:12220:x1870604214019968:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947516.604612:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947516.604634:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500bfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.604752:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500c05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.604768:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500c05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.604779:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500c05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947516.604790:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783947516.604902:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500bfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40a7 expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.604922:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500c05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40a7 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.604951:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89a00) 00010000:00010000:3.0:1783947516.604954:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947516.604958:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50600, rc 0) 00000100:00100000:3.0:1783947516.605030:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+26:12220:x1870604214019968:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 442us (658us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1783947516.605037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:0.0:1783947516.618933:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.618972:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.619112:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214020352 00000100:00100000:1.0:1783947516.619132:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214020352 00000100:00100000:1.0:1783947516.619201:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1783947516.619213:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+26:2408:x1870604214020352:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947516.619229:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947516.619260:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55500c05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40a7 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.619279:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89a00) 00010000:00010000:1.0:1783947516.619284:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947516.619362:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+25:2408:x1870604214020352:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 151us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947516.619370:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:3.0:1783947516.620927:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214020224 00000100:00100000:3.0:1783947516.620938:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214020224 00000100:00100000:3.0:1783947516.620993:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:3.0:1783947516.621002:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+25:12220:x1870604214020224:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947516.621027:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947516.621048:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500c13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.621225:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500c1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.621240:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.621255:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947516.621267:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783947516.621494:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500c13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ae expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.621532:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500c1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ae expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.621542:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89a00) 00010000:00010000:3.0:1783947516.621545:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783947516.621548:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50200, rc 0) 00000100:00100000:3.0:1783947516.621605:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+27:12220:x1870604214020224:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 604us (2681us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1783947516.621613:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:1.0:1783947516.629508:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.629598:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214020480 00000100:00100000:0.0:1783947516.629621:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214020480 00000100:00100000:0.0:1783947516.629681:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:0.0:1783947516.629692:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604214020480:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:0.0:1783947516.629743:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.629765:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.629774:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947516.629779:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947516.629784:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.629819:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.629833:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 6 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947516.629850:0:8539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1870604236108160:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947516.629946:0:8539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947516.638082:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947516.638194:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214020608 00000100:00100000:3.0:1783947516.638206:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214020608 00002000:00100000:3.0:1783947516.638265:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9e7ac7fd0e00 x1870604214020608/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:307/0 lens 504/0 e 0 to 0 dl 1783947527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783947516.638277:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7fd0e00 with x1870604214020608 ext(0->12) 00010000:00010000:3.0:1783947516.638289:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 7 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.638308:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 7 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947516.638317:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7ac7fd0e00 00000100:00100000:3.0:1783947516.638354:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1783947516.638364:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214020608:12345-192.168.204.3@tcp:4:lfs.0 00000100:00100000:0.0:1783947516.639954:0:8539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1870604236108160:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947516.640165:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947516.645910:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+9:2407:x1870604214020608:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 7535us (7827us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783947516.645941:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00002000:00100000:3.0:1783947516.645956:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9e7ac7fd0e00 x1870604214020608/t4294967306(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:307/0 lens 504/448 e 0 to 0 dl 1783947527 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783947516.645967:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7fd0e00 with x1870604214020608 ext(0->12) 00010000:00010000:3.0:1783947516.645977:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 9 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.645998:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 9 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947516.646006:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7ac7fd0e00 00000100:00100000:1.0:1783947516.657096:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.657342:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214020736 00000100:00100000:0.0:1783947516.657353:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214020736 00010000:00010000:0.0:1783947516.657397:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 9 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947516.657498:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:0.0:1783947516.657507:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604214020736:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947516.657524:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783947516.657542:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783947516.657545:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783947515 00002000:00010000:0.0:1783947516.657559:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783947515 00002000:00010000:0.0:1783947516.657561:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783947515 00002000:00010000:0.0:1783947516.657564:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783947516.657571:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 9 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.657585:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 9 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.657610:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002356346f/0xe6fd1fdb55500bdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4092 expref: 9 pid: 8426 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.657626:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947516.657630:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947516.657635:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.657657:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.657693:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947516.657874:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657887:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657919:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657928:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657936:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657954:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947516.657959:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657968:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657980:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.657987:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500c28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947516.658187:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214020736:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 680us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.658196:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 83 00000100:00100000:1.0:1783947516.658340:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214020480:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 28647us (28839us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947516.658349:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:3.0:1783947516.660774:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947516.660799:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236108288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947516.660866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947516.661115:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236108288 00000100:00100000:2.0:1783947516.661124:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236108288 00000100:00100000:2.0:1783947516.661187:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783947516.661197:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236108288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947516.661219:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947516.661270:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236108288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.661276:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783947516.661321:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236108288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947516.661474:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236108672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.661510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947516.661527:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236109184:0@lo:400:kworker.0 00000100:00080000:1.0:1783947516.661653:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947516.661691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947516.661787:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236108672 00000100:00100000:0.0:1783947516.661792:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236108672 00000100:00100000:0.0:1783947516.661825:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783947516.661833:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236108672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947516.661872:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236108672:12345-0@lo:400:kworker.0 Request processed in 40us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.661878:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783947516.661937:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236108800:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.662116:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236109696:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.662160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947516.663184:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236108544:0@lo:400:kworker.0 00000100:00100000:3.0:1783947516.663301:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236108416:0@lo:400:kworker.0 00000100:00100000:3.0:1783947516.663335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947516.663371:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236108928:0@lo:400:kworker.0 00000100:00100000:3.0:1783947516.663394:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947516.663410:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236109440:0@lo:400:kworker.0 00000100:00100000:3.0:1783947516.663452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947516.663514:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236108928 00000100:00100000:3.0:1783947516.663519:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236108928 00000100:00100000:3.0:1783947516.663546:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783947516.663567:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236108928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947516.663609:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236108928:12345-0@lo:400:kworker.0 Request processed in 43us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947516.663614:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783947516.663646:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236108928:0@lo:400:kworker.0 00000100:00100000:0.0:1783947516.664081:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236109440 00000100:00100000:0.0:1783947516.664086:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236109440 00000100:00100000:0.0:1783947516.664128:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783947516.664136:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236109440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947516.664179:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236109440:12345-0@lo:400:kworker.0 Request processed in 45us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.664186:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783947516.664244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.664268:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214020992 00000100:00100000:0.0:1783947516.664272:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214020992 00000100:00100000:0.0:1783947516.664318:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:0.0:1783947516.664324:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+27:12220:x1870604214020992:12345-192.168.204.3@tcp:35:lfs.0 00000004:00010000:0.0:1783947516.664376:0:14165:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500c1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ae expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947516.664647:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1783947516.664681:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1783947516.665150:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1783947516.665191:0:14165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.665208:0:14165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.665217:0:14165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.665250:0:14165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.665264:0:14165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 31 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947516.665278:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9353480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14165:1870604236109952:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947516.665345:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947516.667072:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236108416 00000100:00100000:0.0:1783947516.667084:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236108416 00000100:00100000:0.0:1783947516.667129:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1783947516.667139:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236108416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947516.667221:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3640:x1870604236108416:12345-0@lo:400:kworker.0 Request processed in 83us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.667230:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1783947516.668502:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236108672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.668542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947516.668883:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3640:1870604236108416:0@lo:400:kworker.0 00000100:00100000:3.0:1783947516.668900:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236109440:0@lo:400:kworker.0 00000100:00100000:3.0:1783947516.669018:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947516.669047:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9353480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14165:1870604236109952:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947516.669066:0:14165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947516.669094:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214021120 00000100:00100000:3.0:1783947516.669099:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214021120 00010000:00010000:3.0:1783947516.669127:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 32 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947516.669158:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 84 00000100:00100000:3.0:1783947516.669167:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+32:2406:x1870604214021120:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947516.669182:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947516.669188:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 32 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.669216:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 32 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.669238:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500bc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4084 expref: 32 pid: 6512 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.669254:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89a00) 00010000:00010000:3.0:1783947516.669259:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.669269:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.669276:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.669295:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947516.669343:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+31:2406:x1870604214021120:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 177us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947516.669350:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 84 00010000:00010000:3.0:1783947516.669373:0:14165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947516.669379:0:14165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947516.669703:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1783947516.669882:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1783947516.669974:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14165:1870604236110080:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1783947516.670022:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947516.670045:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947516.670063:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236110080 00000100:00100000:3.0:1783947516.670066:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236110080 00000100:00100000:3.0:1783947516.670094:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783947516.670101:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14165:x1870604236110080:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1783947516.670167:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14165:x1870604236110080:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947516.670173:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783947516.670202:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14165:1870604236110080:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1783947516.670301:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1783947516.670335:0:14165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14165:1870604236110208:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1783947516.670361:0:14165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947516.670375:0:14165:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947516.670386:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236110208 00000100:00100000:3.0:1783947516.670389:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236110208 00000100:00100000:3.0:1783947516.670410:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783947516.670415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14165:x1870604236110208:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1783947516.671100:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236109184 00000100:00100000:1.0:1783947516.671108:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236109184 00000100:00080000:1.0:1783947516.671134:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947516.671171:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236109696 00000100:00100000:1.0:1783947516.671175:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236109696 00000100:00100000:1.0:1783947516.671203:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1783947516.671210:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236109184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947516.671272:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236109184:12345-0@lo:400:kworker.0 Request processed in 62us (9580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947516.671278:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1783947516.671294:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1783947516.671300:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236109696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947516.671329:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236109696:12345-0@lo:400:kworker.0 Request processed in 29us (9168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947516.671334:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:1.0:1783947516.671346:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947516.671814:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14165:x1870604236110208:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 1397us (1450us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783947516.671822:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:3.0:1783947516.673190:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7f800 x1870604236109184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947516.673207:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236109184:0@lo:400:kworker.0 00010000:00080000:3.0:1783947516.673221:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7f9aa00 x1870604236109696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947516.673245:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236109696:0@lo:400:kworker.0 00000100:00100000:1.0:1783947516.673373:0:14165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14165:1870604236110208:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1783947516.673673:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1783947516.673866:0:14165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.673878:0:14165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.673886:0:14165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.673893:0:14165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947516.673897:0:14165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947516.674064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947516.674088:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236109312:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.674137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947516.674165:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236109824:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.674187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947516.674223:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236109312 00000100:00100000:2.0:1783947516.674229:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236109312 00000100:00100000:2.0:1783947516.674264:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236109824 00000100:00100000:2.0:1783947516.674267:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236109824 00000100:00100000:2.0:1783947516.674299:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783947516.674307:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236109312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.674356:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236109312:12345-0@lo:400:kworker.0 Request processed in 50us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.674362:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783947516.674378:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783947516.674384:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236109824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.674410:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236109824:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.674416:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1783947516.674450:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947516.674490:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236109312:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.674501:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236109824:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.674538:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236108544 00000100:00100000:2.0:1783947516.674541:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236108544 00010000:00010000:1.0:1783947516.674803:0:14165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.674822:0:14165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89a00) 00010000:00010000:1.0:1783947516.674825:0:14165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783947516.674830:0:14165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.674836:0:14165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c2f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947516.675050:0:14165:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783947516.675116:0:14165:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1783947516.675128:0:14165:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401902670095ns, next at 402902667974ns, rc = 0 00000001:00080000:1.0:1783947516.675135:0:14165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1783947516.675169:0:14165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89a00) 00010000:00010000:1.0:1783947516.675172:0:14165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783947516.675179:0:14165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55500c1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ae expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947516.675292:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+34:12220:x1870604214020992:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 10967us (11048us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1783947516.675301:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000020:00080000:1.0:1783947516.675305:0:14165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783947516.675808:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236108800 00000100:00100000:2.0:1783947516.675815:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236108800 00000100:00100000:2.0:1783947516.675839:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783947516.675846:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236108544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.675896:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236108544:12345-0@lo:400:kworker.0 Request processed in 51us (7353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.675926:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783947516.675944:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783947516.675950:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236108800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.675985:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236108800:12345-0@lo:400:kworker.0 Request processed in 36us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.675991:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783947516.676028:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236108800:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.676067:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236108544:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.676076:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236109056:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.676106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947516.676126:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236109568:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.676148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947516.676166:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236109056 00000100:00100000:2.0:1783947516.676169:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236109056 00000100:00100000:2.0:1783947516.676198:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236109568 00000100:00100000:2.0:1783947516.676202:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236109568 00000100:00100000:2.0:1783947516.676217:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1783947516.676223:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236109056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.676254:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236109056:12345-0@lo:400:kworker.0 Request processed in 31us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.676259:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1783947516.676270:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1783947516.676275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236109568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.676303:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236109568:12345-0@lo:400:kworker.0 Request processed in 27us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947516.676315:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:2.0:1783947516.676334:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947516.676356:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236109568:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.676379:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236109056:0@lo:400:kworker.0 00000100:00100000:2.0:1783947516.679398:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.679704:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214021248 00000100:00100000:0.0:1783947516.679712:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214021248 00000100:00100000:0.0:1783947516.679848:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:0.0:1783947516.679858:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+34:12220:x1870604214021248:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947516.679880:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947516.679902:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500c36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.679969:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500c36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40b5 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.679984:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500c36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40b5 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.680002:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947516.680005:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947516.680008:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ba00, rc 0) 00000100:00100000:0.0:1783947516.680068:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+35:12220:x1870604214021248:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 212us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.680075:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:1.0:1783947516.683300:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947516.683405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214021504 00000100:00100000:3.0:1783947516.683415:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214021504 00000100:00100000:3.0:1783947516.683501:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947516.683511:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+35:12220:x1870604214021504:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:3.0:1783947516.683778:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+36:12220:x1870604214021504:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 267us (487us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1783947516.683786:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947516.802809:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947516.803018:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214021760 00000100:00100000:2.0:1783947516.803028:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214021760 00000100:00100000:2.0:1783947516.803090:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:2.0:1783947516.803100:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+36:12230:x1870604214021760:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947516.803126:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947516.803147:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947516.803245:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783947516.803353:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500c3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40bc expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.803367:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:2.0:1783947516.803371:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947516.803376:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40bc expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947516.803390:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e000, rc 0) 00000100:00100000:2.0:1783947516.803522:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+37:12230:x1870604214021760:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 423us (722us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1783947516.803529:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1783947516.807896:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.808087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214021888 00000100:00100000:0.0:1783947516.808098:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214021888 00000100:00100000:0.0:1783947516.808160:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00100000:0.0:1783947516.808172:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+37:12230:x1870604214021888:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:0.0:1783947516.808268:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808286:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808301:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808311:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808318:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808324:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808405:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808414:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808622:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947516.808676:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808690:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808707:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808713:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808720:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947516.808731:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808740:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808752:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:0.0:1783947516.808756:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.808761:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808767:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808781:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808787:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808793:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808798:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947516.808807:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808814:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808823:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:0.0:1783947516.808826:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.808828:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808834:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808845:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808851:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808857:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808862:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947516.808865:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808871:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808879:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947516.808881:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.808891:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.808896:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947516.808994:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+37:12230:x1870604214021888:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 824us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947516.809002:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00100000:0.0:1783947516.812563:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.812748:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214022144 00000100:00100000:1.0:1783947516.812760:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214022144 00000100:00100000:1.0:1783947516.812821:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:1.0:1783947516.812831:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+37:12230:x1870604214022144:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947516.813148:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+38:12230:x1870604214022144:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 316us (605us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1783947516.813156:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:3.0:1783947516.861365:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.861497:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214022400 00000100:00100000:0.0:1783947516.861511:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214022400 00000100:00100000:0.0:1783947516.861589:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:0.0:1783947516.861599:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+38:12233:x1870604214022400:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947516.861626:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947516.861650:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.861839:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.861855:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.861866:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.861877:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.861884:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.861914:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862038:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862047:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862054:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947516.862063:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783947516.862148:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862155:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862162:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862169:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947516.862173:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862182:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862195:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:0.0:1783947516.862198:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.862209:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862215:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500c67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862230:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862236:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862241:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862246:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947516.862249:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862254:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862261:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:0.0:1783947516.862264:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947516.862267:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862273:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862315:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862341:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 40 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947516.862349:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947516.862351:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947516.862358:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9aa00, rc 0) 00000100:00100000:0.0:1783947516.862559:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+40:12233:x1870604214022400:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 961us (1206us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783947516.862567:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:2.0:1783947516.866189:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947516.866280:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214022528 00000100:00100000:1.0:1783947516.866288:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214022528 00000100:00100000:1.0:1783947516.866336:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 166 00000100:00100000:1.0:1783947516.866346:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+40:12233:x1870604214022528:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1783947516.866411:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866438:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866451:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866683:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866707:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866714:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866720:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947516.866787:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866796:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866808:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947516.866812:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947516.866817:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947516.866823:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500c83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947516.866969:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+40:12233:x1870604214022528:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 557us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947516.866979:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 166 00000100:00100000:1.0:1783947516.870601:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947516.870807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214022784 00000100:00100000:0.0:1783947516.870818:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214022784 00000100:00100000:0.0:1783947516.870917:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1783947516.870927:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+40:12233:x1870604214022784:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947516.871183:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+41:12233:x1870604214022784:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 257us (590us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783947516.871191:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00010000:00010000:0.0:1783947517.109376:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947517.173909:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947517.173935:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236110336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947517.174022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947517.174493:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236110336 00000100:00100000:1.0:1783947517.174503:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236110336 00000100:00100000:1.0:1783947517.174568:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783947517.174578:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236110336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947517.174640:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947517.174698:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236110336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.174706:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783947517.174988:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236110336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947517.272948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947517.273054:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214023040 00000100:00100000:0.0:1783947517.273064:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214023040 00000100:00100000:0.0:1783947517.273128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 167 00000100:00100000:0.0:1783947517.273140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+41:12264:x1870604214023040:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:0.0:1783947517.273168:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947517.273193:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40ca expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.273328:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.273344:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.273355:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947517.273367:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783947517.273511:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500c8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ca expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.273528:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ca expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.273536:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947517.273539:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947517.273542:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:0.0:1783947517.273673:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+43:12264:x1870604214023040:12345-192.168.204.3@tcp:101:cat.0 Request processed in 536us (735us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1783947517.273681:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 167 00000100:00100000:2.0:1783947517.287152:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947517.287211:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947517.287311:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214023424 00000100:00100000:3.0:1783947517.287324:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214023424 00000100:00100000:0.0:1783947517.287389:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214023168 00000100:00100000:3.0:1783947517.287393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:0.0:1783947517.287395:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214023168 00000100:00100000:3.0:1783947517.287406:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+44:12264:x1870604214023424:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:0.0:1783947517.287486:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1783947517.287497:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+44:2408:x1870604214023168:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947517.287510:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947517.287550:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ca expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.287573:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947517.287579:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947517.287650:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+44:2408:x1870604214023168:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 156us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947517.287658:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1783947517.287695:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+43:12264:x1870604214023424:12345-192.168.204.3@tcp:35:cat.0 Request processed in 291us (552us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1783947517.287705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000040:00080000:2.0:1783947517.301330:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947517.418833:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947517.418992:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214023680 00000100:00100000:0.0:1783947517.419004:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214023680 00000100:00100000:0.0:1783947517.419069:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 168 00000100:00100000:0.0:1783947517.419080:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+43:12270:x1870604214023680:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:0.0:1783947517.419104:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947517.419107:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783947517.419134:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500bf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40a0 expref: 43 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.419154:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:0.0:1783947517.419160:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947517.419174:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c9f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.419279:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.419293:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.419324:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.419355:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.419368:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 43 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947517.419381:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236110464:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947517.419535:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947517.423236:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9350000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236110464:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947517.423267:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947517.423847:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947517.423991:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214023808 00000100:00100000:0.0:1783947517.424003:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214023808 00010000:00010000:0.0:1783947517.424044:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 44 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947517.424081:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 85 00000100:00100000:0.0:1783947517.424091:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+44:2406:x1870604214023808:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947517.424106:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947517.424113:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 44 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.424124:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 44 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.424145:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500c75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40c3 expref: 44 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.424173:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947517.424178:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.424186:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.424193:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.424227:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947517.424287:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+43:2406:x1870604214023808:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 196us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947517.424293:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 85 00010000:00010000:3.0:1783947517.424488:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.424496:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947517.424526:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783947517.424695:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500c9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.424923:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.424931:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947517.424934:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947517.424936:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:3.0:1783947517.424967:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+43:12270:x1870604214023680:12345-192.168.204.3@tcp:101:dd.0 Request processed in 5890us (6144us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1783947517.424974:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 168 00000100:00100000:0.0:1783947517.429087:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947517.429164:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214023936 00000100:00100000:1.0:1783947517.429176:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214023936 00000100:00100000:1.0:1783947517.429246:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 169 00000100:00100000:1.0:1783947517.429257:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+43:12270:x1870604214023936:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:1.0:1783947517.429285:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947517.429309:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500cb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40d8 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.429346:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.429361:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.429373:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.429549:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500cb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 45 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.429566:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 44 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.429586:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947517.429589:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947517.429593:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55c00, rc 0) 00000100:00100000:1.0:1783947517.429825:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+44:12270:x1870604214023936:12345-192.168.204.3@tcp:101:dd.0 Request processed in 570us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.429833:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 169 00000100:00100000:1.0:1783947517.437025:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947517.437105:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214024192 00000100:00100000:0.0:1783947517.437115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214024192 00000100:00100000:0.0:1783947517.437180:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 170 00000100:00100000:0.0:1783947517.437190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+44:12270:x1870604214024192:12345-192.168.204.3@tcp:36:dd.0 00010000:00010000:0.0:1783947517.437811:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.437830:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.437842:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947517.437891:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1783947517.437932:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4ac8efd reply state 00000000300d9949 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.437946:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.437954:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947517.437956:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947517.437960:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947517.438111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+47:12270:x1870604214024192:12345-192.168.204.3@tcp:36:dd.0 Request processed in 920us (1094us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1783947517.438119:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 170 00000020:00080000:0.0:1783947517.438125:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783947517.680447:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947517.681968:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214024320 00000100:00100000:3.0:1783947517.681987:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214024320 00000100:00100000:3.0:1783947517.682169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:3.0:1783947517.682183:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+47:12284:x1870604214024320:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:3.0:1783947517.682218:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947517.682261:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500cc9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40df expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682362:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682382:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682444:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682487:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682496:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682503:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682972:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682988:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.682997:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.683044:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.683063:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 48 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947517.683080:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236110592:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947517.687099:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947517.689970:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1870604236110592:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947517.690013:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947517.696254:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947517.696394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214024576 00000100:00100000:1.0:1783947517.696418:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214024576 00000100:00100000:1.0:1783947517.696543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:1.0:1783947517.696556:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+49:6176:x1870604214024576:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947517.696959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+50:6176:x1870604214024576:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 405us (718us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1783947517.696967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:3.0:1783947517.708590:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947517.711057:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214024704 00000100:00100000:1.0:1783947517.711078:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214024704 00010000:00010000:1.0:1783947517.711148:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 50 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947517.711211:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 86 00000100:00100000:1.0:1783947517.711223:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+50:2407:x1870604214024704:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947517.711243:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947517.711251:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 50 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.711290:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 50 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.711320:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500ca6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d1 expref: 50 pid: 6510 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.711345:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947517.711352:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.711362:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.711370:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947517.711424:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947517.711579:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+49:2407:x1870604214024704:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 358us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947517.711589:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 86 00010000:00010000:2.0:1783947517.712347:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712359:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947517.712442:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783947517.712448:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947517.712520:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712746:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712761:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712781:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712787:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712793:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947517.712798:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712807:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712823:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947517.712826:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947517.712831:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712838:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb55500cd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712855:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712861:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712866:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.712871:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947517.712880:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.713354:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.713367:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:2.0:1783947517.713370:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947517.713374:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.713380:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500cd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.713449:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500cc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40df expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.714053:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40df expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.714064:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947517.714066:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947517.714069:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51e00, rc 0) 00000100:00100000:2.0:1783947517.714211:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+48:12284:x1870604214024320:12345-192.168.204.3@tcp:101:stat.0 Request processed in 32029us (33776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947517.714221:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 171 00000100:00100000:3.0:1783947517.772130:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947517.772312:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214024960 00000100:00100000:2.0:1783947517.772326:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214024960 00000100:00100000:2.0:1783947517.772438:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 172 00000100:00100000:2.0:1783947517.772452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+48:12290:x1870604214024960:12345-192.168.204.3@tcp:36:truncate.0 00010000:00010000:2.0:1783947517.772614:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947517.772652:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500cde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40df expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947517.772679:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947517.772685:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947517.773999:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.774027:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.774045:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947517.774936:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1783947517.775009:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4343cae reply state 000000009e5008e8 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.775028:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947517.775038:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947517.775041:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947517.775046:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947517.775226:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+50:12290:x1870604214024960:12345-192.168.204.3@tcp:36:truncate.0 Request processed in 2771us (3105us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1783947517.775238:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 172 00000020:00080000:3.0:1783947517.775247:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783947517.926007:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947517.931291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214025088 00000100:00100000:0.0:1783947517.931317:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214025088 00000100:00100000:0.0:1783947517.931438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 173 00000100:00100000:0.0:1783947517.931451:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+50:12304:x1870604214025088:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:0.0:1783947517.931505:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947517.931537:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500cec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40e6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931635:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931654:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931669:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931709:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931718:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931725:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931819:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931830:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931837:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947517.931891:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783947517.931898:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947517.931925:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931940:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931949:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931957:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931976:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931983:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947517.931989:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.931999:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932015:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:0.0:1783947517.932019:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947517.932025:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932033:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500cf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932048:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932055:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932061:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932067:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947517.932070:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932087:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932098:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:0.0:1783947517.932100:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947517.932103:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932110:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500cfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932147:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500cec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932163:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947517.932171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947517.932174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947517.932176:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:0.0:1783947517.932274:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+51:12304:x1870604214025088:12345-192.168.204.3@tcp:101:stat.0 Request processed in 825us (6281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947517.932284:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 173 00000040:00080000:3.0:1783947518.003797:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947518.003812:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947518.003942:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1783947518.003954:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783947518.042150:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.042385:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214025344 00000100:00100000:2.0:1783947518.042407:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214025344 00000100:00100000:2.0:1783947518.042603:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 174 00000100:00100000:2.0:1783947518.042619:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+51:12314:x1870604214025344:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947518.042648:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947518.042678:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40ed expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947518.042853:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783947518.043123:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ed expref: 53 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.043142:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:2.0:1783947518.043145:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947518.043150:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40ed expref: 53 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.043168:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947518.043302:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+52:12314:x1870604214025344:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 688us (1168us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1783947518.043311:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 174 00000100:00080000:0.0:1783947518.044439:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947518.050629:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947518.051675:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214025600 00000100:00100000:1.0:1783947518.051692:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214025600 00000100:00100000:1.0:1783947518.051793:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:1.0:1783947518.051805:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+52:12314:x1870604214025600:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947518.052234:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+53:12314:x1870604214025600:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 429us (1618us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1783947518.052262:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:1.0:1783947518.130871:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947518.131003:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214025856 00000100:00100000:0.0:1783947518.131017:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214025856 00000100:00100000:0.0:1783947518.131104:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 175 00000100:00100000:0.0:1783947518.131117:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+53:12320:x1870604214025856:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947518.131172:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947518.131202:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500d16 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40f4 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.131371:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.131390:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.131412:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.131500:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.131515:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 54 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947518.131532:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236110720:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947518.131652:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4900 going to sleep for 11 seconds 00010000:00010000:1.0:1783947518.136575:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947518.137735:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947518.137945:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214025984 00000100:00100000:3.0:1783947518.137957:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214025984 00000100:00100000:0.0:1783947518.137979:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bd9352300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236110720:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947518.138013:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.138020:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 55 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947518.138066:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 87 00000100:00100000:3.0:1783947518.138077:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+55:2406:x1870604214025984:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947518.138097:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947518.138105:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 55 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.138119:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 55 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.138147:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500d01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40e6 expref: 55 pid: 6512 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.138168:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947518.138173:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.138187:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.138196:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.138274:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947518.138348:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+54:2406:x1870604214025984:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 272us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947518.138357:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 87 00010000:00010000:0.0:1783947518.140277:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.140300:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947518.140968:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1783947518.141187:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500d16 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 55 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.141217:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 54 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.141228:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947518.141231:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783947518.141235:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:0.0:1783947518.141385:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+54:12320:x1870604214025856:12345-192.168.204.3@tcp:101:bash.0 Request processed in 10269us (10526us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783947518.141404:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 175 00000100:00100000:2.0:1783947518.145568:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947518.145731:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214026240 00000100:00100000:1.0:1783947518.145745:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214026240 00000100:00100000:1.0:1783947518.145833:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 176 00000100:00100000:1.0:1783947518.145846:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+54:12320:x1870604214026240:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:1.0:1783947518.146168:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.146192:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.146206:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947518.146259:0:8291:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1783947518.146284:0:8291:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d16e0fe5 reply state 00000000f58961b3 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.146300:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.146309:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947518.146312:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947518.146317:0:8291:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947518.146449:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+57:12320:x1870604214026240:12345-192.168.204.3@tcp:36:bash.0 Request processed in 604us (895us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1783947518.146498:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 176 00000020:00080000:1.0:1783947518.146660:0:8291:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783947518.154553:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.154813:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214026368 00000100:00100000:2.0:1783947518.154829:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214026368 00000100:00100000:2.0:1783947518.154913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 177 00000100:00100000:2.0:1783947518.154926:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+57:12320:x1870604214026368:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947518.154962:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947518.154994:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e40fb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.155123:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.155144:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 58 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.155156:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.155203:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 58 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.155218:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 58 pid: 12193 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947518.155233:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236110848:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947518.155348:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a62cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947518.160054:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.160709:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236110848:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947518.160719:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214026496 00000100:00100000:0.0:1783947518.160729:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214026496 00010000:00010000:2.0:1783947518.160773:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.161074:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 59 pid: 12193 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947518.161123:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 88 00000100:00100000:0.0:1783947518.161136:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+59:2407:x1870604214026496:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947518.161157:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947518.161167:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 59 pid: 12193 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.161182:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 59 pid: 12193 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.161239:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40f4 expref: 59 pid: 12193 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.161262:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947518.161267:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.161280:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.161290:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.161323:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947518.161359:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.161369:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947518.161409:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+58:2407:x1870604214026496:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 275us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.161419:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 88 00000004:00200000:2.0:1783947518.162626:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783947518.162637:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947518.162677:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.162729:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40fb expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.162749:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40fb expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.162758:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947518.162761:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947518.162765:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f800, rc 0) 00000100:00100000:2.0:1783947518.163001:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+57:12320:x1870604214026368:12345-192.168.204.3@tcp:101:bash.0 Request processed in 8076us (8462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947518.163011:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 177 00000100:00100000:1.0:1783947518.166412:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947518.166717:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214026752 00000100:00100000:3.0:1783947518.166731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214026752 00000100:00100000:3.0:1783947518.166976:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:3.0:1783947518.166993:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+57:12320:x1870604214026752:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:3.0:1783947518.167287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+58:12320:x1870604214026752:12345-192.168.204.3@tcp:35:bash.0 Request processed in 298us (896us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783947518.167353:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:1.0:1783947518.284297:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947518.284538:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214027008 00000100:00100000:0.0:1783947518.284551:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214027008 00000100:00100000:0.0:1783947518.288113:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 178 00000100:00100000:0.0:1783947518.288152:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+58:12330:x1870604214027008:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947518.288191:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947518.288224:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4102 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947518.288399:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783947518.288700:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4102 expref: 60 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.288741:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:0.0:1783947518.288744:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947518.288750:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4102 expref: 60 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.288770:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:0.0:1783947518.288884:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+59:12330:x1870604214027008:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 753us (4602us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1783947518.289031:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 178 00000100:00100000:0.0:1783947518.293235:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.294127:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214027136 00000100:00100000:2.0:1783947518.294216:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214027136 00000100:00100000:2.0:1783947518.294364:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 179 00000100:00100000:2.0:1783947518.294378:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+59:12330:x1870604214027136:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:2.0:1783947518.294506:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294525:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294549:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294561:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294569:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294575:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294675:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294684:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294691:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947518.294742:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294767:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294786:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294793:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294799:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947518.294804:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294812:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294827:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947518.294830:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947518.294844:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294852:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294865:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294871:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294876:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294881:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947518.294890:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294896:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294903:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:2.0:1783947518.294905:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947518.294907:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294912:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294920:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294925:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294930:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294935:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947518.294937:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294942:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294949:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947518.294951:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947518.294960:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.294966:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947518.295054:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+59:12330:x1870604214027136:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 678us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947518.295062:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 179 00000100:00100000:3.0:1783947518.303229:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947518.303387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214027392 00000100:00100000:0.0:1783947518.303680:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214027392 00000100:00100000:0.0:1783947518.303802:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:0.0:1783947518.303815:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+59:12330:x1870604214027392:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947518.304139:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+60:12330:x1870604214027392:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 326us (925us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1783947518.304155:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:1.0:1783947518.343010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.343360:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214027648 00000100:00100000:2.0:1783947518.343377:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214027648 00000100:00100000:2.0:1783947518.343529:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:2.0:1783947518.343542:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+60:12333:x1870604214027648:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947518.343578:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947518.343609:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4109 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.343739:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.343758:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.343771:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.343783:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.343790:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.343820:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.343996:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55500d78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344008:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55500d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344015:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55500d78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947518.344028:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783947518.344133:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344142:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344150:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344157:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947518.344163:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344171:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344187:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947518.344190:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947518.344203:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344210:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e000/0xe6fd1fdb55500d6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344228:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344234:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344240:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344245:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5ec00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947518.344248:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344268:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344277:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:2.0:1783947518.344279:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947518.344282:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344288:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55500d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344340:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55500d63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4109 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344369:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55500d78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4109 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.344377:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947518.344380:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947518.344383:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b400, rc 0) 00000100:00100000:2.0:1783947518.344550:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+62:12333:x1870604214027648:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1010us (1554us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1783947518.344560:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 180 00000100:00100000:3.0:1783947518.349665:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947518.349778:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.349888:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214027904 00000100:00100000:2.0:1783947518.349902:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214027904 00000100:00100000:2.0:1783947518.349983:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:2.0:1783947518.349999:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+62:12333:x1870604214027904:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:2.0:1783947518.350111:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350133:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350147:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350192:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350212:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350245:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350253:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947518.350258:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350272:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350287:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947518.350291:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947518.350296:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.350308:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947518.350445:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+62:12333:x1870604214027904:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 448us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947518.350453:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 181 00000100:00100000:0.0:1783947518.350628:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214027776 00000100:00100000:0.0:1783947518.350635:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214027776 00000100:00100000:0.0:1783947518.350751:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:0.0:1783947518.350762:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+62:2409:x1870604214027776:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947518.350791:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947518.350821:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55500d78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4109 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.350851:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947518.350855:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947518.350892:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+61:2409:x1870604214027776:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 133us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.350901:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1783947518.355643:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947518.355995:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214028160 00000100:00100000:0.0:1783947518.356011:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214028160 00000100:00100000:0.0:1783947518.356106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:0.0:1783947518.356120:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+61:12333:x1870604214028160:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947518.356445:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+62:12333:x1870604214028160:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 327us (817us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1783947518.356453:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:1.0:1783947518.508085:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.508201:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214028416 00000100:00100000:2.0:1783947518.508214:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214028416 00000100:00100000:2.0:1783947518.508302:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:2.0:1783947518.508315:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+62:12352:x1870604214028416:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:2.0:1783947518.508353:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947518.508383:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4110 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.508819:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55500d94 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.508838:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55500d94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.508850:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55500d94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947518.508863:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783947518.509140:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500d8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4110 expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.509164:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55500d94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4110 expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.509173:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947518.509176:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783947518.509180:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:2.0:1783947518.509318:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+64:12352:x1870604214028416:12345-192.168.204.3@tcp:101:cat.0 Request processed in 1005us (1248us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1783947518.509336:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 182 00000100:00100000:3.0:1783947518.555785:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947518.556159:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214028544 00000100:00100000:1.0:1783947518.556173:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214028544 00000100:00100000:1.0:1783947518.556303:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:1.0:1783947518.556318:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+64:12353:x1870604214028544:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947518.556354:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947518.556382:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500da2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4117 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.556587:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500da9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.556606:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.556621:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947518.556679:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783947518.556683:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947518.556708:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.556742:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500da2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4117 expref: 66 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.556768:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500da9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4117 expref: 65 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947518.556800:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947518.556803:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947518.556807:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54800, rc 0) 00000100:00100000:1.0:1783947518.557103:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+65:12353:x1870604214028544:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 788us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947518.557112:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 183 00000100:00100000:3.0:1783947518.569350:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947518.569600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214028928 00000100:00100000:0.0:1783947518.569612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214028928 00000100:00100000:0.0:1783947518.569686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:0.0:1783947518.569700:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+65:12353:x1870604214028928:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947518.570375:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+66:12353:x1870604214028928:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 675us (1035us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1783947518.570393:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:0.0:1783947518.573862:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947518.574008:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214029056 00000100:00100000:2.0:1783947518.574022:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214029056 00000100:00100000:2.0:1783947518.574114:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:2.0:1783947518.574126:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+66:12353:x1870604214029056:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:2.0:1783947518.574146:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783947518.574201:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f800/0xe6fd1fdb55500d39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40fb expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.574230:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55500d94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4110 expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.574246:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500c36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40b5 expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947518.574260:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947518.574266:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947518.574352:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd9353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+63:12353:x1870604214029056:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 228us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947518.574360:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:3.0:1783947518.577431:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947518.583209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214029184 00000100:00100000:0.0:1783947518.583291:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214029184 00000100:00100000:0.0:1783947518.583770:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:0.0:1783947518.583787:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+63:12353:x1870604214029184:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:0.0:1783947518.584274:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.584302:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947518.584317:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947518.584494:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1783947518.584697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+63:12353:x1870604214029184:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 914us (7290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.584708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 184 00000100:00100000:2.0:1783947518.606140:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947518.606274:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214029312 00000100:00100000:3.0:1783947518.606288:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214029312 00000100:00100000:3.0:1783947518.606367:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:3.0:1783947518.606379:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+63:12355:x1870604214029312:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947518.606420:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947518.606509:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500db7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e411e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.607759:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.607791:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.607830:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.607844:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.607852:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.607858:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.609339:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.609368:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.609381:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947518.609491:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783947518.609496:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947518.609523:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.609991:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610009:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610041:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610048:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610055:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947518.610060:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610069:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610084:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947518.610087:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947518.610094:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610099:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500dbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610120:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610126:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610132:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610137:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947518.610147:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610154:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610163:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:3.0:1783947518.610166:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947518.610169:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610175:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500dc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610227:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500db7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610246:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 64 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947518.610254:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947518.610257:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947518.610260:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51e00, rc 0) 00000100:00100000:3.0:1783947518.610380:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+64:12355:x1870604214029312:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 4001us (4252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947518.610399:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 185 00000100:00100000:3.0:1783947518.707803:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947518.707845:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236110976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947518.707945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947518.708136:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236110976 00000100:00100000:0.0:1783947518.708147:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236110976 00000100:00100000:0.0:1783947518.708213:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783947518.708225:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236110976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947518.708288:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783947518.708351:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236110976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947518.708359:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783947518.708819:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236110976:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1783947519.027743:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947519.027760:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947519.027830:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783947519.027847:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783947519.028068:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236111104:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947519.028205:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947519.036297:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.036344:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236111104:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783947519.036401:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214029440 00000100:00100000:1.0:1783947519.036412:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214029440 00000100:00100000:1.0:1783947519.036519:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 186 00000100:00100000:1.0:1783947519.036532:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+64:12366:x1870604214029440:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783947519.036591:0:8291:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947519.036734:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+64:12366:x1870604214029440:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 203us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.036743:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 186 00000001:00080000:2.0:1783947519.041431:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00010000:00010000:1.0:1783947519.041901:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.041918:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.042599:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000004:00080000:2.0:1783947519.042862:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783947519.042889:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7ac77f0540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783947519.042894:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7ac108a700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac77f06c0 00000020:00080000:2.0:1783947519.042897:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bff952c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bf6850e00 00000100:00100000:0.0:1783947519.043175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214029568 00000100:00100000:0.0:1783947519.043189:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214029568 00010000:00010000:1.0:1783947519.043223:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043234:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.043240:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.043269:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 187 00010000:00010000:1.0:1783947519.043274:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.043285:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+22:12366:x1870604214029568:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783947519.043302:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9e7bc8a89200) 00010000:00010000:1.0:1783947519.043306:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.043313:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043320:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50e00/0xe6fd1fdb55500b79 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043351:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043357:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043363:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043367:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.043370:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043386:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043395:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947519.043397:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947519.043400:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043401:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.043426:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043428:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50a00/0xe6fd1fdb55500b80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043446:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.043452:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043472:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043489:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043495:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.043497:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.043503:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043504:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.043521:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043524:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89000) 00010000:00010000:1.0:1783947519.043530:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.043535:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.043537:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043547:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51400/0xe6fd1fdb55500bbf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043566:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043573:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043585:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043590:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.043594:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043600:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043608:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947519.043611:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.043614:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.043620:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55500cc2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783947519.044159:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783947519.044248:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1783947519.045225:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045250:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045265:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.045310:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236111232:0@lo:6:osp-syn-1-0.0 00000004:00200000:0.0:1783947519.045330:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783947519.045336:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947519.045355:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045369:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045388:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.045413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947519.045418:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045438:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947519.045443:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045451:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045478:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:0.0:1783947519.045482:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947519.045486:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045493:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55500dd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045510:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045518:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045529:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045535:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947519.045538:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.045548:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045558:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.045560:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.045575:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045576:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9e7c003e5b00) 00010000:00010000:0.0:1783947519.045582:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.045586:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947519.045588:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.045592:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045600:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55500dda lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.045617:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045621:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045629:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045634:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045640:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947519.045643:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045649:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045656:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:0.0:1783947519.045658:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947519.045661:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.045677:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500de1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.045763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214029568:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 2481us (3170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.045775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 187 00000100:00100000:0.0:1783947519.045831:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236111232 00000100:00100000:0.0:1783947519.045840:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236111232 00000100:00100000:0.0:1783947519.045899:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783947519.045910:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236111232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783947519.045944:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1783947519.045981:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a54e0fb, atime: 0x6a54e0fb, ctime: 0x6a54e0fb, blocks: 0x8 00010000:00010000:0.0:1783947519.045988:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.046004:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1783947519.046009:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947519.046017:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.046031:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.046041:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046046:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947519.046050:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.046054:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046339:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51c00/0xe6fd1fdb55500ce5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046358:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046365:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046372:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046389:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.046393:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046399:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046410:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947519.046413:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.046416:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.046434:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500d2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.047450:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.047487:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947519.048194:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947519.048206:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.048236:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947519.048241:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.048253:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.048279:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.048287:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000442c7c76/0xe6fd1fdb55500de8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.048317:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947519.048319:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947519.048321:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947519.048331:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236111232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2416us (2914us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783947519.048343:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1783947519.048400:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1783947519.048825:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7ac7fd1f80/2, rc 0, transno 4294967308 00000100:00100000:3.0:1783947519.048836:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236111232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783947519.053216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.053596:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214029824 00000100:00100000:2.0:1783947519.053612:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214029824 00000100:00100000:2.0:1783947519.053695:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 188 00000100:00100000:2.0:1783947519.053709:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+17:12366:x1870604214029824:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947519.053739:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947519.053768:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500def lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4125 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.053911:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.053937:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.053951:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947519.053966:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783947519.055482:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055503:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055512:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055518:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ae00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947519.055523:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055532:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055552:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:2.0:1783947519.055556:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947519.055562:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055568:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500df6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055638:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500def lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4125 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055663:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:2.0:1783947519.055666:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947519.055671:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55500def lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4125 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.055682:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b200, rc 0) 00000100:00100000:2.0:1783947519.055794:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+18:12366:x1870604214029824:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 2087us (2587us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1783947519.055804:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 188 00000100:00100000:2.0:1783947519.065573:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.068545:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214029952 00000100:00100000:0.0:1783947519.068566:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214029952 00000100:00100000:0.0:1783947519.068655:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:0.0:1783947519.068668:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+18:12366:x1870604214029952:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783947519.068730:0:6511:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783947519.069172:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+18:12366:x1870604214029952:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 260us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.069182:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 189 00000100:00100000:0.0:1783947519.079668:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.083700:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214030208 00000100:00100000:3.0:1783947519.083719:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214030208 00000100:00100000:3.0:1783947519.083811:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:3.0:1783947519.083825:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:12366:x1870604214030208:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947519.083854:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947519.083858:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947519.083913:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500da9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4117 expref: 18 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.083933:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947519.083939:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947519.084637:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500e04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e412c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783947519.086363:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1783947519.087245:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500e0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.087269:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.087284:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.088692:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51a00/0xe6fd1fdb55500e04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e412c expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.088751:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e412c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.088763:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7bc5593b00) 00010000:00010000:2.0:1783947519.088778:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947519.088783:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846ae00, rc 0) 00000100:00100000:2.0:1783947519.088905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214030208:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 5081us (9252us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1783947519.088916:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 190 00000100:00100000:0.0:1783947519.099667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.100105:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214030464 00000100:00100000:3.0:1783947519.100127:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214030464 00000100:00100000:3.0:1783947519.100208:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:3.0:1783947519.100219:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214030464:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947519.100321:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947519.100360:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55500e0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e412c expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100392:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7bc5593b00) 00010000:00010000:3.0:1783947519.100405:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947519.100529:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100547:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100560:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100577:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100584:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100591:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100647:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100656:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100668:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100676:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.100681:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100690:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100700:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947519.100704:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.100708:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100714:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500e19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100725:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100731:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100737:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100742:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.100745:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100760:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100768:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x24a2f4b4 (ffff9e7bc8a89d00) 00010000:00010000:3.0:1783947519.100770:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.100773:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.100779:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x24a2f4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.101069:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+18:12366:x1870604214030464:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 850us (1411us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947519.101078:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 191 00000100:00100000:3.0:1783947519.103498:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.104333:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214030592 00000100:00100000:0.0:1783947519.104349:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214030592 00000100:00100000:0.0:1783947519.104589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:0.0:1783947519.104602:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+18:12366:x1870604214030592:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947519.104630:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947519.104661:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4133 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.104735:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.104753:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.104766:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.104916:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.104935:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.104946:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:0.0:1783947519.104949:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947519.104954:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ba00, rc 0) 00000100:00100000:0.0:1783947519.105108:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214030592:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 509us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.105116:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 192 00000100:00100000:0.0:1783947519.108305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.108503:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214030848 00000100:00100000:2.0:1783947519.108516:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214030848 00000100:00100000:2.0:1783947519.108590:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:2.0:1783947519.108602:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214030848:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947519.108712:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.108733:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.108746:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947519.109314:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1783947519.109326:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404336868481ns, next at 405336865765ns, rc = 0 00000004:00010000:2.0:1783947519.109407:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066ed4d20 reply state 0000000094e542c5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.109424:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.109434:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:2.0:1783947519.109437:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783947519.109441:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947519.109707:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+21:12366:x1870604214030848:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 1104us (1413us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1783947519.109723:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 193 00000100:00100000:0.0:1783947519.116214:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.116836:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214030976 00000100:00100000:3.0:1783947519.116851:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214030976 00000100:00100000:3.0:1783947519.116920:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00100000:3.0:1783947519.116933:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+21:12366:x1870604214030976:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947519.116969:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947519.116997:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e413a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.117076:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.117094:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.117129:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:3.0:1783947519.117132:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947519.117136:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50c00, rc 0) 00000100:00100000:3.0:1783947519.117212:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+22:12366:x1870604214030976:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 281us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.117218:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 194 00000100:00100000:3.0:1783947519.124216:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.124269:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214031104 00000100:00100000:3.0:1783947519.124282:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214031104 00000100:00100000:3.0:1783947519.124356:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:3.0:1783947519.124368:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+6:2407:x1870604214031104:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783947519.124697:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214031104:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 330us (491us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783947519.124706:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00080000:3.0:1783947519.124733:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947519.134754:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.135092:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214031360 00000100:00100000:0.0:1783947519.135106:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214031360 00000100:00100000:0.0:1783947519.135184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:0.0:1783947519.135196:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+22:12366:x1870604214031360:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783947519.136213:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+23:12366:x1870604214031360:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 1012us (1465us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1783947519.136226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:1.0:1783947519.143191:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.143232:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214031616 00000100:00100000:0.0:1783947519.143246:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214031616 00000100:00100000:0.0:1783947519.143327:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:0.0:1783947519.143342:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+23:12366:x1870604214031616:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783947519.143718:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+23:12366:x1870604214031616:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 378us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.143728:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 195 00000100:00100000:1.0:1783947519.153975:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.154126:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214031744 00000100:00100000:0.0:1783947519.154140:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214031744 00000100:00100000:0.0:1783947519.154221:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 196 00000100:00100000:0.0:1783947519.154233:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+23:12366:x1870604214031744:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947519.154260:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947519.154287:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4141 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.154392:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.154412:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.154434:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947519.154655:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947519.154683:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.154716:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4141 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.154735:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4141 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.154744:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:0.0:1783947519.154748:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783947519.154752:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:0.0:1783947519.154826:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+24:12366:x1870604214031744:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 594us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.154835:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 196 00010000:00010000:3.0:1783947519.157288:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947519.160399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.160625:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214031872 00000100:00100000:0.0:1783947519.160707:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214031872 00000100:00100000:0.0:1783947519.160803:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1783947519.160823:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604214031872:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947519.160848:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947519.160910:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4148 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947519.160945:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e0fe, blocks: 0x0 00010000:00010000:0.0:1783947519.160973:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1783947519.160987:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947519.161071:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.161096:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.161114:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9aa00, rc 0) 00000100:00100000:0.0:1783947519.161193:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214031872:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 372us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.161201:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:1.0:1783947519.165829:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.166177:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214032128 00000100:00100000:3.0:1783947519.166192:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214032128 00000100:00100000:3.0:1783947519.166308:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:3.0:1783947519.166322:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+24:12366:x1870604214032128:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947519.166516:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+24:12366:x1870604214032128:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 197us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.166525:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 197 00000100:00100000:1.0:1783947519.175781:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.176537:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214032256 00000100:00100000:0.0:1783947519.176554:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214032256 00000100:00100000:0.0:1783947519.176632:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:0.0:1783947519.176645:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+8:12366:x1870604214032256:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947519.176670:0:10351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947519.176705:0:10351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e414f expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.176748:0:10351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 9 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.176760:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947519.176766:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947519.176772:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 9 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.176833:0:10351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 9 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.176851:0:10351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 9 pid: 8539 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.176868:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10351:1870604236111360:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947519.176995:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947519.187980:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.188078:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214032384 00000100:00100000:3.0:1783947519.188088:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214032384 00000100:00100000:2.0:1783947519.188097:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10351:1870604236111360:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947519.188142:0:10351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 10 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.188143:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 10 pid: 8539 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.188169:0:10351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:3.0:1783947519.188223:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:3.0:1783947519.188234:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+10:2407:x1870604214032384:12345-192.168.204.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1783947519.188241:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+10:12366:x1870604214032256:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 11600us (12476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.188248:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00010000:00010000:3.0:1783947519.188251:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947519.188280:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 9 pid: 8539 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.188295:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 9 pid: 8539 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.188323:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008baf704d/0xe6fd1fdb55500e51 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4148 expref: 9 pid: 8539 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.188337:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947519.188342:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947519.188351:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 8 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.188361:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 8 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.188412:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 8 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.188436:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1870604236111488:192.168.204.3@tcp:105: 00000100:00100000:3.0:1783947519.188674:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947519.190803:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1870604236111488:192.168.204.3@tcp:105: 00010000:00010000:3.0:1783947519.190833:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947519.190904:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214032384:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 2671us (2936us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.190917:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 89 00000100:00100000:1.0:1783947519.195035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.195248:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214032512 00000100:00100000:0.0:1783947519.195261:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214032512 00002000:00100000:0.0:1783947519.195328:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9e7ac7f78000 x1870604214032512/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:310/0 lens 504/0 e 0 to 0 dl 1783947530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947519.195340:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7f78000 with x1870604214032512 ext(0->8) 00002000:00010000:0.0:1783947519.195347:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac7f78000 00000100:00100000:0.0:1783947519.195399:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1783947519.195410:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214032512:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783947519.197136:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+10:2407:x1870604214032512:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 1714us (2100us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1783947519.197164:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00002000:00100000:0.0:1783947519.197178:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9e7ac7f78000 x1870604214032512/t4294967315(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:310/0 lens 504/448 e 0 to 0 dl 1783947530 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947519.197189:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7f78000 with x1870604214032512 ext(0->8) 00002000:00010000:0.0:1783947519.197201:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac7f78000 00000100:00100000:0.0:1783947519.199943:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.200061:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214032640 00000100:00100000:1.0:1783947519.200076:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214032640 00000100:00100000:1.0:1783947519.200243:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 198 00000100:00100000:1.0:1783947519.200256:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+24:12366:x1870604214032640:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783947519.202016:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1783947519.202035:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:1.0:1783947519.202049:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.202068:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.202077:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.202084:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.202090:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.202100:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.202138:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:1.0:1783947519.202142:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947519.202149:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.202155:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a400/0xe6fd1fdb55500e35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.202246:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947519.202269:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236111616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783947519.202352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947519.202414:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236111616 00000100:00100000:0.0:1783947519.202422:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236111616 00000100:00080000:1.0:1783947519.202483:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947519.202527:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783947519.202537:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236111616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783947519.202709:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783947519.202713:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783947518 00002000:00010000:0.0:1783947519.202715:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783947519.202718:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783947518 -> 1783947518 00002000:00010000:0.0:1783947519.202720:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783947519.202774:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1870604236111616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (420us total) trans 4294967316 rc 0/0 00000004:00080000:3.0:1783947519.202839:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7ac84b2300/2, rc 0, transno 4294967316 00000100:00100000:3.0:1783947519.202846:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236111616:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1783947519.203003:0:6489:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1783947519.203049:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1783947519.203069:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783947519.203094:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947519.203182:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214032640:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 2926us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.203191:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 198 00000100:00100000:2.0:1783947519.206319:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.206832:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214032768 00000100:00100000:0.0:1783947519.206845:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214032768 00000100:00100000:0.0:1783947519.206916:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:0.0:1783947519.206929:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+10:2407:x1870604214032768:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783947519.212085:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1783947519.212107:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1783947519.212316:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214032768:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 5381us (6005us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.212330:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:1.0:1783947519.221675:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.222209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214033024 00000100:00100000:2.0:1783947519.222226:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214033024 00000100:00100000:2.0:1783947519.222312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 199 00000100:00100000:2.0:1783947519.222325:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac712ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214033024:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947519.222412:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947519.222452:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4141 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.222499:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:2.0:1783947519.222633:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947519.222675:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.222708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.222719:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947519.222965:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e32d703f reply state 000000003e435c7f transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.222980:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.222988:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:2.0:1783947519.222990:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783947519.222994:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947519.223175:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac712ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+20:12366:x1870604214033024:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 852us (1511us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1783947519.223185:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 199 00000100:00100000:1.0:1783947519.226360:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.226663:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214033152 00000100:00100000:2.0:1783947519.226677:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214033152 00000100:00100000:2.0:1783947519.226791:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:2.0:1783947519.226803:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604214033152:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783947519.227017:0:10351:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783947519.227022:0:10351:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783947518 -> 1783947517 00002000:00010000:2.0:1783947519.227025:0:10351:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783947515 00002000:00010000:2.0:1783947519.227028:0:10351:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783947518 -> 1783947517 00002000:00010000:2.0:1783947519.227030:0:10351:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783947519.227106:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7beeeeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214033152:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 304us (759us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783947519.227131:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:1.0:1783947519.229567:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.229688:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214033408 00000100:00100000:3.0:1783947519.229702:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214033408 00000100:00100000:3.0:1783947519.229762:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 200 00000100:00100000:3.0:1783947519.229773:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+20:12366:x1870604214033408:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783947519.229874:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.229896:0:8291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.229906:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.229952:0:8291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.229985:0:8291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 20 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.230004:0:8291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236111744:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947519.230111:0:8291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947519.232683:0:8291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236111744:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947519.232720:0:8291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947519.234336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.234434:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214033536 00000100:00100000:0.0:1783947519.234447:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214033536 00010000:00010000:0.0:1783947519.234548:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 21 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.234798:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:2.0:1783947519.234814:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+21:2406:x1870604214033536:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947519.234833:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947519.234843:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 21 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.234858:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 21 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.234886:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ba00/0xe6fd1fdb55500e2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4133 expref: 21 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.234904:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:2.0:1783947519.234910:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.234922:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.234931:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.234970:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947519.235034:0:8291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235044:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235098:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235106:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235114:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235121:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.235126:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235135:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235146:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:3.0:1783947519.235149:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783947519.235162:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.235170:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500e66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.236739:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+20:2406:x1870604214033536:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1915us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.236757:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 90 00000100:00100000:3.0:1783947519.236762:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+20:12366:x1870604214033408:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 6987us (7203us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783947519.236773:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 200 00000100:00100000:1.0:1783947519.240323:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.243643:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214033664 00000100:00100000:0.0:1783947519.243664:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214033664 00000100:00100000:0.0:1783947519.243764:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:0.0:1783947519.243907:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214033664:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783947519.243972:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.243998:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 8 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.244009:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947519.244013:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783947519.244018:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.244062:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 8 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.244079:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 8 pid: 10351 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.244098:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870604236111872:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947519.245063:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947519.250538:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.250617:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214033792 00000100:00100000:2.0:1783947519.250632:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214033792 00010000:00010000:2.0:1783947519.250692:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 9 pid: 10351 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.250748:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 91 00000100:00100000:2.0:1783947519.250763:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604214033792:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947519.250860:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947519.250893:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 9 pid: 10351 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.250909:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 9 pid: 10351 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.250940:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947519.250946:0:9516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947519.250953:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.250965:0:9516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.250992:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947519.251053:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604214033792:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 295us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.251059:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 91 00010000:00010000:0.0:1783947519.252746:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55500e58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e414f expref: 8 pid: 10351 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.252802:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8426:1870604236111872:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947519.252838:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.252853:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.252925:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.252963:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.252972:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.252980:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.252987:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947519.252992:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.253003:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.253032:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.253042:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000422e9adc/0xe6fd1fdb55500e6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.253260:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214033664:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 9484us (12950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947519.253274:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:1.0:1783947519.257140:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.259078:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214034048 00000100:00100000:0.0:1783947519.259097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214034048 00000100:00100000:0.0:1783947519.259236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 201 00000100:00100000:0.0:1783947519.259249:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+19:12366:x1870604214034048:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783947519.259380:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.259405:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 19 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.259417:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.259510:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 19 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.259527:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 19 pid: 8291 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.259564:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112000:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947519.259688:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947519.262011:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112000:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947519.262049:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.262661:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.262767:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214034176 00000100:00100000:1.0:1783947519.262777:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214034176 00010000:00010000:1.0:1783947519.262887:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 20 pid: 8291 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947519.262949:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 92 00000100:00100000:1.0:1783947519.262960:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+20:2407:x1870604214034176:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947519.262980:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947519.262988:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 20 pid: 8291 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.263076:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 20 pid: 8291 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.263159:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500cbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e40d8 expref: 20 pid: 8291 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.263178:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:1.0:1783947519.263182:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.263191:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.263198:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.263223:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947519.263250:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.263257:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947519.263293:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+19:2407:x1870604214034176:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 335us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.263301:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 92 00010000:00010000:2.0:1783947519.263604:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.263627:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.263637:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.263679:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.264517:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 19 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.264544:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112128:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947519.264655:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd1a62000 going to sleep for 11 seconds 00000100:00100000:2.0:1783947519.272753:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.272801:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214034304 00000100:00100000:2.0:1783947519.272813:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214034304 00010000:00010000:2.0:1783947519.272873:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 20 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.272921:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 93 00000100:00100000:2.0:1783947519.272934:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+20:2407:x1870604214034304:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947519.272954:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947519.272963:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 20 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.272979:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 20 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.273021:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:2.0:1783947519.273027:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.273038:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.273047:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.273070:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947519.273139:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1eb923ac-790a-478f-897e-124614dbce09+20:2407:x1870604214034304:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 208us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.273148:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 93 00010000:00010000:0.0:1783947519.274635:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb55500e3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e413a expref: 19 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.274666:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112128:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947519.274700:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.274711:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.274717:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947519.274949:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1783947519.275276:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1783947519.275326:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1783947519.275587:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1870604236112256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783947519.275681:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947519.275728:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947519.275793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236112256 00000100:00100000:3.0:1783947519.275802:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236112256 00000100:00100000:3.0:1783947519.275869:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783947519.275881:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6511:x1870604236112256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947519.275998:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6511:x1870604236112256:12345-0@lo:1000:mdt00_001.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.276006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783947519.276093:0:6511:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1783947519.276101:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7ac84b2300, transno 4294967316 00000100:00100000:2.0:1783947519.276127:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1870604236112256:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1783947519.276283:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1783947519.276341:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1870604236112384:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783947519.276392:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947519.276411:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f3b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947519.276606:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236112384 00000100:00100000:3.0:1783947519.276610:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236112384 00000100:00100000:3.0:1783947519.276648:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783947519.276657:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6511:x1870604236112384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947519.276857:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6511:x1870604236112384:12345-0@lo:1000:mdt00_001.0 Request processed in 200us (463us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1783947519.276864:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783947519.276905:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1870604236112384:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783947519.276948:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.276958:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.276974:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.276981:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.276987:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.276996:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277016:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:3.0:1783947519.277020:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947519.277026:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277035:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb55500e7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277062:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277069:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277075:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277080:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.277083:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277100:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277110:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947519.277112:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947519.277115:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277121:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55500db0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277150:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277167:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277176:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277207:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.277224:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 22 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.277240:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112512:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947519.277324:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947519.281202:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112512:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947519.281253:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.282403:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.282890:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214034432 00000100:00100000:3.0:1783947519.282903:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214034432 00010000:00010000:3.0:1783947519.282956:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 23 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.283011:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 94 00000100:00100000:3.0:1783947519.283023:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+23:2407:x1870604214034432:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947519.283042:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947519.283051:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 23 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283067:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 23 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283111:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500dcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e411e expref: 23 pid: 6510 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283130:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947519.283136:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283147:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283156:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283221:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947519.283291:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+22:2407:x1870604214034432:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 269us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.283299:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 94 00010000:00010000:3.0:1783947519.283332:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283340:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283354:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283362:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283541:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283550:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.283556:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283564:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283575:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947519.283579:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.283583:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283599:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500e82 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283613:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283619:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283625:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283629:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.283632:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283637:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283645:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7c003e5700) 00010000:00010000:3.0:1783947519.283647:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783947519.283650:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.283655:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb55500e74 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783947519.283950:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947519.283956:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947519.284526:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1783947519.284538:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783947519.284677:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+21:12366:x1870604214034048:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 25425us (27546us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1783947519.284691:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 201 00000020:00080000:3.0:1783947519.284697:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783947519.288940:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947519.290712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214034688 00000100:00100000:0.0:1783947519.290732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214034688 00000100:00100000:0.0:1783947519.290835:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:0.0:1783947519.290851:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+21:12366:x1870604214034688:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783947519.292320:0:6514:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783947519.292368:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1783947519.292435:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.292476:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.292491:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.292501:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.292509:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.292515:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947519.292544:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947519.292659:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947519.292668:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.292676:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947519.292681:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.292688:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+23:12366:x1870604214034688:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 1836us (3759us total) trans 4294967470 rc 0/0 00010000:00010000:3.0:1783947519.292690:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947519.292699:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00010000:00010000:3.0:1783947519.292705:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:3.0:1783947519.292708:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783947519.292714:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783947519.292715:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783947519.292720:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55500e89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.292735:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947519.292737:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947519.292739:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783947519.462580:0:14601:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783947519.462607:0:14601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947519.462641:0:14601:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783947519.462651:0:14601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947519.593079:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.593177:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214034944 00000100:00100000:1.0:1783947519.593187:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214034944 00000100:00100000:1.0:1783947519.593249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 202 00000100:00100000:1.0:1783947519.593260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+23:12376:x1870604214034944:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947519.593290:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947519.593312:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4156 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.593442:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500e97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.593491:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500e97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.593504:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500e97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947519.593517:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783947519.593626:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4156 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.593645:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500e97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4156 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.593654:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947519.593657:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947519.593670:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55200, rc 0) 00000100:00100000:1.0:1783947519.593732:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+25:12376:x1870604214034944:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 474us (674us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1783947519.593740:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 202 00000100:00100000:0.0:1783947519.599705:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.600003:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214035072 00000100:00100000:3.0:1783947519.600013:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214035072 00000100:00100000:3.0:1783947519.600075:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 203 00000100:00100000:3.0:1783947519.600085:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+25:12376:x1870604214035072:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:3.0:1783947519.600178:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600196:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600208:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600223:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600231:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600237:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600316:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600324:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600331:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947519.600394:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600408:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600425:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600431:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600437:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.600442:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600450:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600499:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947519.600502:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.600507:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600513:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600525:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600530:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600535:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600539:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.600547:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600553:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600561:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89d00) 00010000:00010000:3.0:1783947519.600563:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.600566:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600571:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500eac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600585:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600590:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600595:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600600:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.600603:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600608:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600616:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:3.0:1783947519.600618:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.600627:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.600633:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500eb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.600713:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+25:12376:x1870604214035072:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 629us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.600722:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 203 00000100:00100000:0.0:1783947519.659886:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.660089:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214035328 00000100:00100000:3.0:1783947519.660101:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214035328 00000100:00100000:3.0:1783947519.660608:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 204 00000100:00100000:3.0:1783947519.660621:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+25:12379:x1870604214035328:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947519.660644:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947519.660670:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500eba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e415d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660765:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660781:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660794:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660808:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660816:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660840:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660962:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660969:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.660987:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947519.660998:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783947519.661083:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661092:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661098:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661105:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.661109:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661116:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661128:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947519.661131:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.661142:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661149:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500ec1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661160:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661166:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661172:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661177:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.661180:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661185:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661193:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7bc8a89c00) 00010000:00010000:3.0:1783947519.661195:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947519.661198:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661204:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500ec8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661247:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500eba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661272:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.661279:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:3.0:1783947519.661281:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947519.661283:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51200, rc 0) 00000100:00100000:3.0:1783947519.661355:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+27:12379:x1870604214035328:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 738us (1477us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1783947519.661373:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 204 00000100:00100000:0.0:1783947519.667161:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.667271:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214035456 00000100:00100000:1.0:1783947519.667283:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214035456 00000100:00100000:1.0:1783947519.667352:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 205 00000100:00100000:1.0:1783947519.667373:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+27:12379:x1870604214035456:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:1.0:1783947519.668496:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668517:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668528:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668632:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668641:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668649:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668655:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.668660:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668667:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668695:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947519.668698:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947519.668745:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.668753:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500edd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947519.668869:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+27:12379:x1870604214035456:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 1507us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.668876:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 205 00000100:00100000:0.0:1783947519.671675:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.671785:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214035712 00000100:00100000:3.0:1783947519.671795:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214035712 00000100:00100000:1.0:1783947519.671890:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:1.0:1783947519.671903:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+27:12379:x1870604214035712:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947519.672186:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+28:12379:x1870604214035712:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 286us (518us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1783947519.672195:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1783947519.706209:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.706695:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214035968 00000100:00100000:1.0:1783947519.706706:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214035968 00000100:00100000:1.0:1783947519.706818:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 206 00000100:00100000:1.0:1783947519.706828:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+28:11911:x1870604214035968:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947519.706854:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947519.706878:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500ee4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4164 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.706988:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.707020:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.707030:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.707064:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.707079:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 29 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947519.707093:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236112640:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947519.707229:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0188480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947519.710031:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.710214:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214036096 00000100:00100000:3.0:1783947519.710223:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214036096 00010000:00010000:3.0:1783947519.710272:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 30 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947519.710296:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236112640:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947519.710312:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 95 00000100:00100000:3.0:1783947519.710320:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+30:2406:x1870604214036096:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947519.710334:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.710335:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947519.710341:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 30 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.710352:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 30 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.710383:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500ecf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e415d expref: 30 pid: 6511 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.710413:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:3.0:1783947519.710418:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.710427:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.710435:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.710499:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947519.710559:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+29:2406:x1870604214036096:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 238us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.710567:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 95 00010000:00010000:1.0:1783947519.711341:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.711352:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947519.711381:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783947519.711561:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500ee4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 30 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.711592:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 29 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.711600:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947519.711603:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947519.711606:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54e00, rc 0) 00000100:00100000:1.0:1783947519.711704:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+29:11911:x1870604214035968:12345-192.168.204.3@tcp:101:bash.0 Request processed in 4877us (5505us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1783947519.711712:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 206 00000100:00100000:0.0:1783947519.714933:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.715018:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214036224 00000100:00100000:1.0:1783947519.715028:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214036224 00000100:00100000:1.0:1783947519.715088:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 207 00000100:00100000:1.0:1783947519.715099:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+29:11911:x1870604214036224:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947519.715142:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947519.715166:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500ef9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e416b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.715202:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500f00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.715216:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.715228:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.715356:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500ef9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e416b expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.715392:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500f00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e416b expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.715401:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947519.715404:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947519.715408:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54200, rc 0) 00000100:00100000:1.0:1783947519.715502:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+30:11911:x1870604214036224:12345-192.168.204.3@tcp:101:bash.0 Request processed in 406us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.715510:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 207 00000100:00100000:0.0:1783947519.718794:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.718882:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214036480 00000100:00100000:1.0:1783947519.718893:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214036480 00000100:00100000:1.0:1783947519.718958:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 208 00000100:00100000:1.0:1783947519.718970:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+30:11911:x1870604214036480:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:1.0:1783947519.719208:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.719224:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.719235:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947519.719289:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1783947519.719329:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a946c110 reply state 00000000bba38a5c transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.719342:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.719373:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947519.719376:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947519.719379:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783947519.719422:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1783947519.719710:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+34:11911:x1870604214036480:12345-192.168.204.3@tcp:36:bash.0 Request processed in 742us (924us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783947519.719719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 208 00000020:00080000:1.0:1783947519.719724:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783947519.722356:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.722549:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214036608 00000100:00100000:1.0:1783947519.722560:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214036608 00000100:00100000:1.0:1783947519.722616:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 209 00000100:00100000:1.0:1783947519.722625:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+34:11911:x1870604214036608:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947519.722671:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947519.722691:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500f0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4172 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.722743:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500f0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4172 expref: 35 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.722756:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500f0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4172 expref: 35 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.722772:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947519.722775:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783947519.722778:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55c00, rc 0) 00000100:00100000:1.0:1783947519.722823:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+35:11911:x1870604214036608:12345-192.168.204.3@tcp:101:bash.0 Request processed in 201us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947519.722846:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 209 00000100:00100000:0.0:1783947519.726957:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.727220:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214036736 00000100:00100000:2.0:1783947519.727230:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214036736 00000100:00100000:2.0:1783947519.727326:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1783947519.727337:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:11911:x1870604214036736:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947519.727357:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947519.727398:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4179 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947519.727426:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a54e0fd, atime: 0x6a54e0fb, ctime: 0x6a54e0fd, blocks: 0x8 00010000:00010000:2.0:1783947519.727452:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1783947519.727497:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947519.727507:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.727526:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.727539:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846aa00, rc 0) 00000100:00100000:2.0:1783947519.727593:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+8:11911:x1870604214036736:12345-192.168.204.3@tcp:101:bash.0 Request processed in 257us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.727600:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:0.0:1783947519.731419:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.731546:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214036864 00000100:00100000:3.0:1783947519.731556:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214036864 00002000:00010000:3.0:1783947519.731596:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1783947519.731600:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7f7b480 with x1870604214036864 ext(0->18446744073709551615) 00002000:00010000:3.0:1783947519.731612:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac7f7b480. 00000100:00100000:3.0:1783947519.731715:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:3.0:1783947519.731725:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214036864:12345-192.168.204.3@tcp:10:bash.0 00002000:00010000:3.0:1783947519.731972:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1783947519.732752:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783947517 -> 1783947518 00002000:00010000:3.0:1783947519.732756:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1783947515 -> 1783947515 00002000:00010000:3.0:1783947519.732759:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783947517 -> 1783947518 00002000:00010000:3.0:1783947519.732762:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1783947519.732837:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604214036864:12345-192.168.204.3@tcp:10:bash.0 Request processed in 1112us (1427us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1783947519.734135:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00002000:00010000:3.0:1783947519.734143:0:8433:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1783947519.734147:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac7f7b480 with x1870604214036864 ext(0->18446744073709551615) 00002000:00010000:3.0:1783947519.734159:0:8433:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac7f7b480. 00000100:00100000:0.0:1783947519.818013:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.818126:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214036992 00000100:00100000:2.0:1783947519.818136:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214036992 00000100:00100000:2.0:1783947519.818252:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 210 00000100:00100000:2.0:1783947519.818263:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+35:12393:x1870604214036992:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:2.0:1783947519.818336:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818353:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818379:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818415:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818423:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818430:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818576:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818586:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818594:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783947519.818657:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818669:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818676:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818683:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818689:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947519.818694:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818710:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818723:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947519.818726:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947519.818730:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818738:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818753:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818759:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818765:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818771:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947519.818774:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818780:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818787:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7ac761ed00) 00010000:00010000:2.0:1783947519.818790:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947519.818792:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818808:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818823:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818830:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818836:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818841:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947519.818845:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818850:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818858:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:2.0:1783947519.818860:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947519.818863:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.818868:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.818939:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+35:12393:x1870604214036992:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 677us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.818946:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 210 00000100:00100000:0.0:1783947519.867780:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.867877:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214037248 00000100:00100000:1.0:1783947519.867888:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214037248 00000100:00100000:1.0:1783947519.867957:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00100000:1.0:1783947519.867969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+35:12396:x1870604214037248:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947519.867993:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947519.868016:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4180 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868176:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868191:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868202:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868216:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868223:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868230:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868349:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500f46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868387:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868395:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947519.868405:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783947519.868808:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868815:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868821:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868826:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.868831:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868838:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868850:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947519.868854:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.868858:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868864:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868877:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868890:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868895:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868900:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947519.868904:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868910:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868918:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:1.0:1783947519.868921:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947519.868924:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868929:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868972:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4180 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868984:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4180 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947519.868991:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947519.868992:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783947519.869000:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54400, rc 0) 00000100:00100000:1.0:1783947519.869171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+37:12396:x1870604214037248:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1203us (1400us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1783947519.869179:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 211 00000100:00100000:0.0:1783947519.873199:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.873410:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214037376 00000100:00100000:3.0:1783947519.873420:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214037376 00000100:00100000:3.0:1783947519.873515:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:3.0:1783947519.873571:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+37:12396:x1870604214037376:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:3.0:1783947519.873645:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.873664:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 37 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.873673:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.873709:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 37 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.873722:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 37 pid: 12193 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.873737:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112768:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947519.873844:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947519.883133:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.883263:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236112768:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947519.883286:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214037632 00000100:00100000:1.0:1783947519.883293:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214037632 00010000:00010000:3.0:1783947519.883303:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947519.883339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:1.0:1783947519.883349:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+38:6644:x1870604214037632:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783947519.883966:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+39:6644:x1870604214037632:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 616us (840us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1783947519.883975:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1783947519.894369:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947519.894499:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214037760 00000100:00100000:3.0:1783947519.894510:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214037760 00010000:00010000:3.0:1783947519.894819:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 39 pid: 12193 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947519.895354:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 96 00000100:00100000:2.0:1783947519.895381:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+39:2407:x1870604214037760:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947519.895398:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947519.895407:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 39 pid: 12193 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.895597:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 39 pid: 12193 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.895625:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb55500eeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4164 expref: 39 pid: 12193 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.895715:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:2.0:1783947519.895721:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.895730:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.895738:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.895772:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947519.895838:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+38:2407:x1870604214037760:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 464us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947519.895846:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 96 00010000:00010000:3.0:1783947519.896819:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896831:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896889:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896897:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896903:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896910:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947519.896915:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896923:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896937:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:3.0:1783947519.896940:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947519.896960:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947519.896967:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947519.897042:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+37:12396:x1870604214037376:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 23474us (23851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947519.897053:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 212 00000100:00100000:0.0:1783947519.900388:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947519.901185:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214038016 00000100:00100000:1.0:1783947519.901197:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214038016 00000100:00100000:1.0:1783947519.901255:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:1.0:1783947519.901265:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+37:12396:x1870604214038016:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947519.902781:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+38:12396:x1870604214038016:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 1510us (2398us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1783947519.902793:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:0.0:1783947519.993649:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947519.995274:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214038272 00000100:00100000:2.0:1783947519.995299:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214038272 00000100:00100000:2.0:1783947519.995383:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00100000:2.0:1783947519.995411:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+38:12407:x1870604214038272:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:2.0:1783947519.995447:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947519.995486:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4187 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996062:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996084:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996098:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996127:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996135:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996142:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996266:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a800/0xe6fd1fdb55500f70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996275:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a800/0xe6fd1fdb55500f70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996282:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a800/0xe6fd1fdb55500f70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947519.996304:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1783947519.996402:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996410:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996416:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996421:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947519.996425:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996433:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996446:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947519.996450:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947519.996485:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996492:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b600/0xe6fd1fdb55500f62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996504:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996510:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996526:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996532:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947519.996535:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.996541:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.997852:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7ac761ed00) 00010000:00010000:2.0:1783947519.997860:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947519.997868:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.997877:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a200/0xe6fd1fdb55500f69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.997946:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55500f5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4187 expref: 41 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.997962:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a800/0xe6fd1fdb55500f70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4187 expref: 40 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947519.997970:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:2.0:1783947519.997972:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947519.997983:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a800, rc 0) 00000100:00100000:2.0:1783947519.998068:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+40:12407:x1870604214038272:12345-192.168.204.3@tcp:101:cat.0 Request processed in 2658us (4427us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1783947519.998091:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 213 00000100:00100000:0.0:1783947520.008572:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.008860:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214038528 00000100:00100000:1.0:1783947520.008871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214038528 00000100:00100000:1.0:1783947520.008947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:1.0:1783947520.008958:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+40:12407:x1870604214038528:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:1.0:1783947520.009271:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+41:12407:x1870604214038528:12345-192.168.204.3@tcp:35:cat.0 Request processed in 314us (718us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1783947520.009278:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00080000:3.0:1783947520.009520:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947520.048293:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.048593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214038784 00000100:00100000:1.0:1783947520.048617:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214038784 00000100:00100000:1.0:1783947520.049210:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 214 00000100:00100000:1.0:1783947520.049223:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+41:12408:x1870604214038784:12345-192.168.204.3@tcp:36:rm.0 00010000:00010000:1.0:1783947520.049290:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1783947520.049320:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500f0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4172 expref: 41 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049343:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a800/0xe6fd1fdb55500f70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4187 expref: 40 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049367:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54400/0xe6fd1fdb55500f46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4180 expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049381:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb55500f00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e416b expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049391:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947520.049396:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947520.049419:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049431:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049441:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049453:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049529:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049536:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049620:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049629:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049646:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947520.049892:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:1.0:1783947520.049950:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049959:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.049966:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050577:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050588:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050594:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050738:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947520.050765:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050773:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050778:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050784:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947520.050789:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050797:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050809:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947520.050813:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783947520.050817:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050824:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb55500f8c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050854:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050861:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050868:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050880:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947520.050883:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050890:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050899:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947520.050902:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947520.050905:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050911:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb55500f7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947520.050922:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac7b8d7a reply state 00000000c6f8fdab transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050933:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.050940:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:1.0:1783947520.050943:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947520.050946:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947520.051164:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+39:12408:x1870604214038784:12345-192.168.204.3@tcp:36:rm.0 Request processed in 1942us (2878us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1783947520.051172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 214 00010000:00010000:0.0:1783947520.053934:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947520.053949:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.053962:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947520.053966:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.054148:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.054166:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:0.0:1783947520.054168:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783947520.054173:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.054179:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55500f93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.054195:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947520.054197:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947520.054199:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947520.117879:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947520.118179:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214039040 00000100:00100000:3.0:1783947520.118190:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214039040 00000100:00100000:3.0:1783947520.118313:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 215 00000100:00100000:3.0:1783947520.118325:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+39:12414:x1870604214039040:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947520.118367:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947520.118391:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e418e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.118548:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.118565:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.118578:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.118589:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.118596:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.118618:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947520.119016:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1783947520.121159:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121181:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121193:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121235:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121242:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121249:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121256:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947520.121260:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121268:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121281:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947520.121284:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947520.121304:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121311:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb55500fa1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947520.121327:0:6511:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d2d434e reply state 00000000a96d64ea transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121339:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121346:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:3.0:1783947520.121349:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947520.121352:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783947520.121406:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb55500f9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 42 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121424:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.121432:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:3.0:1783947520.121434:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947520.121437:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50000, rc 0) 00000100:00100000:3.0:1783947520.121570:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+42:12414:x1870604214039040:12345-192.168.204.3@tcp:101:bash.0 Request processed in 3247us (3700us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1783947520.121580:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 215 00000100:00100000:3.0:1783947520.134913:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.136274:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214039168 00000100:00100000:2.0:1783947520.136289:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214039168 00000100:00100000:2.0:1783947520.136394:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:2.0:1783947520.136405:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604214039168:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947520.136427:0:10351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947520.136451:0:10351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4195 expref: -99 pid: 10351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783947520.136511:0:10351:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947520.136535:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1783947520.136539:0:10351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947520.136549:0:10351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 8 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.136569:0:10351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 8 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.136583:0:10351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b600, rc 0) 00000100:00100000:2.0:1783947520.136665:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214039168:12345-192.168.204.3@tcp:101:bash.0 Request processed in 261us (7206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.136672:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00080000:3.0:1783947520.137478:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947520.141199:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.141488:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214039296 00000100:00100000:0.0:1783947520.141499:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214039296 00000100:00100000:0.0:1783947520.141569:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:0.0:1783947520.141580:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+8:12414:x1870604214039296:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947520.141602:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947520.141624:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e419c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.141883:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 9 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.141894:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947520.141899:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947520.141905:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.141961:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 9 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.141989:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 9 pid: 10351 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947520.142005:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8429180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1870604236112896:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947520.142366:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947520.154397:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.154505:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214039424 00000100:00100000:2.0:1783947520.154528:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214039424 00010000:00010000:2.0:1783947520.154567:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 10 pid: 10351 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947520.154621:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 97 00000100:00100000:2.0:1783947520.154644:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+10:2406:x1870604214039424:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947520.154663:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947520.154687:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 10 pid: 10351 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.154702:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 10 pid: 10351 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.154731:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947520.154736:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947520.154745:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.154755:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.154794:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947520.154809:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1870604236113024:192.168.204.3@tcp:105: 00000100:00100000:2.0:1783947520.154898:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f3b180 going to sleep for 11 seconds 00010000:00010000:0.0:1783947520.155408:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55500fbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4195 expref: 10 pid: 10351 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947520.155426:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8429180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8426:1870604236112896:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947520.155508:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.155524:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b600, rc 0) 00000100:00100000:0.0:1783947520.155561:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+9:12414:x1870604214039296:12345-192.168.204.3@tcp:101:bash.0 Request processed in 13983us (14371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947520.155569:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:3.0:1783947520.174513:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1870604236113024:192.168.204.3@tcp:105: 00010000:00010000:3.0:1783947520.174561:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947520.174629:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214039424:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 19997us (20244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947520.174863:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.175005:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214039680 00000100:00100000:0.0:1783947520.175013:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214039680 00000100:00100000:0.0:1783947520.175246:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:0.0:1783947520.175258:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+42:12414:x1870604214039680:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:0.0:1783947520.175584:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+43:12414:x1870604214039680:12345-192.168.204.3@tcp:35:bash.0 Request processed in 328us (721us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1783947520.175592:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:3.0:1783947520.177294:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 97 00010000:00010000:2.0:1783947520.179612:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947520.244015:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236113152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947520.244108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947520.244509:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236113152 00000100:00100000:0.0:1783947520.244518:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236113152 00000100:00100000:0.0:1783947520.244572:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783947520.244581:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236113152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947520.244605:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1783947520.244649:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236113152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947520.244657:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000004:00080000:2.0:1783947520.245025:0:8535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 405472566821ns, next at 406472563966ns, rc = 0 00000100:00100000:1.0:1783947520.245189:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236113280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947520.245245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947520.245497:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947520.245554:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236113152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947520.245785:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236113280 00000100:00100000:2.0:1783947520.245791:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236113280 00000100:00100000:2.0:1783947520.245833:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783947520.245842:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7befbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604236113280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947520.245860:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1783947520.245912:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7befbab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1870604236113280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.245920:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783947520.246413:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236113280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947520.430982:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.431161:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214039808 00000100:00100000:2.0:1783947520.431178:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214039808 00000100:00100000:2.0:1783947520.431441:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 216 00000100:00100000:2.0:1783947520.431487:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+43:12430:x1870604214039808:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947520.431525:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947520.431556:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb55500fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41a3 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.431652:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55500fd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.431670:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55500fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.431683:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55500fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947520.431940:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783947520.431946:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947520.431992:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55500fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.432033:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb55500fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41a3 expref: 45 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.432056:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55500fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41a3 expref: 44 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.432065:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947520.432069:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947520.432073:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b800, rc 0) 00000100:00100000:2.0:1783947520.432159:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+44:12430:x1870604214039808:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 707us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.432168:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 216 00000100:00100000:3.0:1783947520.435634:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.436697:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214040064 00000100:00100000:1.0:1783947520.436715:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214040064 00000100:00100000:1.0:1783947520.436963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 217 00000100:00100000:1.0:1783947520.436978:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+44:12430:x1870604214040064:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947520.437007:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947520.437191:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500fd9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41aa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.437421:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500fe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.437442:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.438316:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947520.438372:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783947520.440559:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500fd9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41aa expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.440602:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41aa expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.440613:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:1.0:1783947520.440637:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947520.440642:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54800, rc 0) 00000100:00100000:1.0:1783947520.441992:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+46:12430:x1870604214040064:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 5004us (6358us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1783947520.442008:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 217 00000100:00100000:0.0:1783947520.455662:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.455724:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947520.455822:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214040448 00000100:00100000:3.0:1783947520.455835:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214040448 00000100:00100000:3.0:1783947520.455926:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:3.0:1783947520.455938:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+46:2406:x1870604214040448:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947520.455958:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947520.455992:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54800/0xe6fd1fdb55500fe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41aa expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.456021:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:3.0:1783947520.456026:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947520.456103:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+45:2406:x1870604214040448:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 168us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947520.456111:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1783947520.456616:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214040320 00000100:00100000:1.0:1783947520.456624:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214040320 00000100:00100000:1.0:1783947520.456667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 218 00000100:00100000:1.0:1783947520.456676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+45:12430:x1870604214040320:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947520.456703:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947520.456724:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500fee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.456847:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500ff5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.456864:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.456875:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947520.456888:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783947520.457017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55500fee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41b1 expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.457035:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41b1 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.457068:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:1.0:1783947520.457072:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783947520.457075:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55400, rc 0) 00000100:00100000:1.0:1783947520.457197:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+47:12430:x1870604214040320:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 521us (1471us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1783947520.457204:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 218 00000100:00100000:0.0:1783947520.467663:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.468514:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214040576 00000100:00100000:2.0:1783947520.468532:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214040576 00000100:00100000:2.0:1783947520.470545:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:2.0:1783947520.470579:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214040576:12345-192.168.204.3@tcp:1:lfs.0 00010000:00010000:2.0:1783947520.471037:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.471196:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.471207:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947520.471213:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947520.471217:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.471296:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.471315:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 8 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947520.471332:0:8539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1870604236113408:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947520.472594:0:8539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f3b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947520.481987:0:8539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1870604236113408:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947520.482030:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947520.489436:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.489550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.489582:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.489623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.489627:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214040960 00000100:00100000:0.0:1783947520.489665:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.489697:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.489707:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214040960 00000100:00100000:0.0:1783947520.489729:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214041088 00000100:00100000:0.0:1783947520.489735:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214041088 00000100:00100000:0.0:1783947520.489809:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:0.0:1783947520.489821:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+9:2408:x1870604214041088:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947520.489847:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214041216 00000100:00100000:2.0:1783947520.489852:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214041216 00000100:00100000:2.0:1783947520.489884:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214041344 00000100:00100000:2.0:1783947520.489887:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214041344 00000100:00100000:2.0:1783947520.489908:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 318 00000100:00100000:2.0:1783947520.489917:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214040960:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947520.489939:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+9:2408:x1870604214041088:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 119us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.489959:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214040960:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 42us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.489977:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 318 00000100:00100000:0.0:1783947520.489978:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:2.0:1783947520.490006:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 319 00000100:00100000:2.0:1783947520.490014:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214041216:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947520.490159:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214040704 00000100:00100000:1.0:1783947520.490169:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214040704 00002000:00100000:1.0:1783947520.490214:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9e7ac842a300 x1870604214040704/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:311/0 lens 504/0 e 0 to 0 dl 1783947531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947520.490227:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac842a300 with x1870604214040704 ext(0->8) 00010000:00010000:1.0:1783947520.490239:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.490258:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947520.490267:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7ac842a300 00000100:00100000:1.0:1783947520.490290:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:1.0:1783947520.490297:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+9:2407:x1870604214040704:12345-192.168.204.3@tcp:4:lfs.0 00000100:00100000:2.0:1783947520.490531:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214041216:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 40us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.490539:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 319 00000100:00100000:2.0:1783947520.490554:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 320 00000100:00100000:2.0:1783947520.490563:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214041344:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947520.490598:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214041344:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 37us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.490604:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 320 00000100:00100000:2.0:1783947520.490630:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214040832 00000100:00100000:2.0:1783947520.490702:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214040832 00000100:00100000:2.0:1783947520.490822:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 386 00000100:00100000:2.0:1783947520.490831:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604214040832:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947520.490865:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604214040832:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 36us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.490872:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 386 00000100:00080000:2.0:1783947520.490911:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947520.490917:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947520.491631:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+11:2407:x1870604214040704:12345-192.168.204.3@tcp:4:lfs.0 Request processed in 1328us (2204us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783947520.491642:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00002000:00100000:1.0:1783947520.491652:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9e7ac842a300 x1870604214040704/t4294967309(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:311/0 lens 504/448 e 0 to 0 dl 1783947531 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783947520.491671:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac842a300 with x1870604214040704 ext(0->8) 00010000:00010000:1.0:1783947520.491681:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 11 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.491699:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 11 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947520.491707:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9e7ac842a300 00000100:00100000:3.0:1783947520.498584:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.498952:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214041472 00000100:00100000:2.0:1783947520.498966:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214041472 00010000:00010000:2.0:1783947520.499086:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 11 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947520.499191:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:2.0:1783947520.499204:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+11:2408:x1870604214041472:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947520.499226:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783947520.499270:0:7462:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783947520.499274:0:7462:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783947519 00002000:00010000:2.0:1783947520.499276:0:7462:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783947519 00002000:00010000:2.0:1783947520.499278:0:7462:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783947519 00002000:00010000:2.0:1783947520.499281:0:7462:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783947520.499289:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 11 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.499306:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 11 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.499337:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb55500fc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e419c expref: 11 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.499374:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947520.499379:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947520.499386:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.499397:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.499439:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947520.499613:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499625:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499651:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499662:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499672:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499681:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ac00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947520.499686:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499697:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499712:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.499734:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000454e20ed/0xe6fd1fdb55501003 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947520.499861:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+10:2407:x1870604214040576:12345-192.168.204.3@tcp:1:lfs.0 Request processed in 29299us (32214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947520.499873:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:2.0:1783947520.500299:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+9:2408:x1870604214041472:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1095us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.500309:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 98 00000100:00100000:3.0:1783947520.510267:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.510902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214041728 00000100:00100000:0.0:1783947520.510918:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214041728 00000100:00100000:1.0:1783947520.511289:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:1.0:1783947520.511303:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+47:12430:x1870604214041728:12345-192.168.204.3@tcp:35:lfs.0 00000004:00010000:1.0:1783947520.511582:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41b1 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947520.512985:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1783947520.513057:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1783947520.513926:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1783947520.513991:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.514018:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 51 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.514030:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.514082:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 51 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.514399:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 51 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.514420:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1870604236113536:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947520.514885:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0188540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947520.518636:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1870604236113536:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947520.518708:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947520.519525:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.519622:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214041856 00000100:00100000:0.0:1783947520.519632:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214041856 00010000:00010000:0.0:1783947520.519683:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 52 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947520.519731:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 99 00000100:00100000:0.0:1783947520.519753:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+52:2407:x1870604214041856:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947520.519774:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947520.519782:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 52 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.519799:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 52 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.519826:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb55500faf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e418e expref: 52 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.519847:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:0.0:1783947520.519872:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.519883:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.519892:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.519928:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947520.520012:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+51:2407:x1870604214041856:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 270us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947520.520028:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 99 00010000:00010000:1.0:1783947520.521513:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.521531:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947520.521692:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1783947520.522386:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1783947520.523003:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236113664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947520.523107:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947520.523155:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947520.523253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236113664 00000100:00100000:3.0:1783947520.523280:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236113664 00000100:00100000:3.0:1783947520.523343:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783947520.523365:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1870604236113664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783947520.523521:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1870604236113664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 158us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947520.523531:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783947520.523651:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236113664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783947520.523944:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1783947520.524027:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236113792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783947520.524060:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947520.524076:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947520.524144:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236113792 00000100:00100000:2.0:1783947520.524157:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236113792 00000100:00100000:2.0:1783947520.524200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783947520.524209:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6513:x1870604236113792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783947520.524358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6513:x1870604236113792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (286us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783947520.524365:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783947520.524602:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ece00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1870604236113792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783947520.524659:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1783947520.524703:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.524714:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.524722:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.524729:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947520.524734:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.524853:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.524876:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:1.0:1783947520.524879:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783947520.524885:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.524893:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550100a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783947520.525751:0:6513:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783947520.525842:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1783947520.525856:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405753398620ns, next at 406753396095ns, rc = 0 00000001:00080000:1.0:1783947520.525865:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1783947520.525906:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7bc8a89c00) 00010000:00010000:1.0:1783947520.525910:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783947520.525928:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55500ff5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41b1 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.526297:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+54:12430:x1870604214041728:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 14995us (16045us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1783947520.526308:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000020:00080000:1.0:1783947520.526313:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783947520.536997:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.537181:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214041984 00000100:00100000:2.0:1783947520.537196:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214041984 00000100:00100000:2.0:1783947520.537325:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 219 00000100:00100000:2.0:1783947520.537340:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+54:12430:x1870604214041984:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947520.537388:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947520.537421:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501011 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41b8 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.537547:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41b8 expref: 55 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.537577:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501011 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41b8 expref: 55 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.537604:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947520.537608:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947520.537613:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846be00, rc 0) 00000100:00100000:2.0:1783947520.537697:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+55:12430:x1870604214041984:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 361us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.537706:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 219 00000100:00100000:1.0:1783947520.540261:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.540358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214042240 00000100:00100000:0.0:1783947520.540373:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214042240 00000100:00100000:0.0:1783947520.540448:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:0.0:1783947520.540504:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+55:12430:x1870604214042240:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947520.540969:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+56:12430:x1870604214042240:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 509us (721us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783947520.540978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:0.0:1783947520.615528:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.615635:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214042368 00000100:00100000:1.0:1783947520.615651:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214042368 00000100:00100000:1.0:1783947520.615783:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 220 00000100:00100000:1.0:1783947520.615798:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+56:12440:x1870604214042368:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1783947520.616436:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616505:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616523:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616538:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616548:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616555:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616662:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616689:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616697:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947520.616766:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616782:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616790:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616796:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616803:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947520.616808:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.616817:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617088:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947520.617092:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947520.617098:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617105:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501018 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617130:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617137:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617143:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617148:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947520.617151:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617157:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617165:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:1.0:1783947520.617167:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947520.617170:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617176:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550101f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617187:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617193:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617199:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617211:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947520.617214:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617221:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617230:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947520.617232:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947520.617236:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.617241:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.617360:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+56:12440:x1870604214042368:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 1552us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947520.617370:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 220 00000100:00100000:3.0:1783947520.649657:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.649976:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214042624 00000100:00100000:2.0:1783947520.650008:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214042624 00000100:00100000:2.0:1783947520.650373:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:2.0:1783947520.650386:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+56:12443:x1870604214042624:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947520.650414:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947520.650442:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb5550102d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41bf expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650584:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650604:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650618:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650629:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650636:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650643:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650809:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650818:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.650824:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947520.650842:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783947520.651366:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651377:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651385:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651392:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947520.651398:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651407:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651425:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947520.651429:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947520.651435:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651443:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501034 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651490:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651497:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651515:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651519:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947520.651522:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651526:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651531:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:2.0:1783947520.651533:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947520.651535:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651539:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb5550103b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651582:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb5550102d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 59 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651595:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 58 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.651601:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947520.651603:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947520.651605:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:2.0:1783947520.651735:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+58:12443:x1870604214042624:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1350us (2093us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1783947520.651755:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 221 00000100:00100000:0.0:1783947520.655001:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.655110:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214042752 00000100:00100000:2.0:1783947520.655124:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214042752 00000100:00100000:2.0:1783947520.655249:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00100000:2.0:1783947520.655263:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+58:12443:x1870604214042752:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:2.0:1783947520.655516:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655536:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655548:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655736:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655745:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655753:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655760:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947520.655766:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655774:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655789:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947520.655812:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947520.655819:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.655825:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb55501050 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947520.656003:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+58:12443:x1870604214042752:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 741us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.656012:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 222 00000100:00100000:0.0:1783947520.657818:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.658018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214043008 00000100:00100000:1.0:1783947520.658032:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214043008 00000100:00100000:1.0:1783947520.658105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:1.0:1783947520.658118:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+58:12443:x1870604214043008:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947520.658817:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+59:12443:x1870604214043008:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 697us (1004us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1783947520.658828:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:3.0:1783947520.725088:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.725374:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214043264 00000100:00100000:1.0:1783947520.725387:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214043264 00000100:00100000:1.0:1783947520.725525:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 223 00000100:00100000:1.0:1783947520.726246:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+59:12453:x1870604214043264:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947520.726284:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947520.726288:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783947520.726326:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55500fd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41a3 expref: 59 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.726362:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947520.726368:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947520.726388:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501057 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.726719:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.728401:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 59 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.728422:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.728503:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 59 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.728521:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 59 pid: 8291 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.728541:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236113920:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947520.728681:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e900 going to sleep for 11 seconds 00000100:00100000:0.0:1783947520.734047:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.734245:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236113920:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947520.734288:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947520.734380:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214043392 00000100:00100000:3.0:1783947520.734390:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214043392 00010000:00010000:3.0:1783947520.734437:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 60 pid: 8291 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947520.734581:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 100 00000100:00100000:3.0:1783947520.734593:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+60:2407:x1870604214043392:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947520.734613:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947520.734622:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 60 pid: 8291 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.734636:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 60 pid: 8291 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.734665:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501042 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41bf expref: 60 pid: 8291 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.734688:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947520.734717:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.734729:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.734738:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.734769:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947520.735053:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.735063:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947520.735089:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783947520.735277:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501057 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.735295:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.735303:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947520.735306:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947520.735309:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55c00, rc 0) 00000100:00100000:3.0:1783947520.735764:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+60:2407:x1870604214043392:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1169us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947520.735775:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 100 00000100:00100000:1.0:1783947520.735904:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+59:12453:x1870604214043264:12345-192.168.204.3@tcp:101:bash.0 Request processed in 10350us (10833us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1783947520.735913:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 223 00000100:00100000:0.0:1783947520.739255:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.739662:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214043520 00000100:00100000:2.0:1783947520.739677:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214043520 00000100:00100000:2.0:1783947520.739759:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 224 00000100:00100000:2.0:1783947520.739773:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+59:12453:x1870604214043520:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947520.739806:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947520.739836:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb5550106c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41cd expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.739882:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.739900:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.739914:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.740083:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb5550106c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 61 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.740602:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 60 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.740618:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947520.740622:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947520.740626:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846ae00, rc 0) 00000100:00100000:2.0:1783947520.740732:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+60:12453:x1870604214043520:12345-192.168.204.3@tcp:101:bash.0 Request processed in 961us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.740791:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 224 00000100:00100000:3.0:1783947520.749266:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.749641:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214043776 00000100:00100000:2.0:1783947520.749661:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214043776 00000100:00100000:3.0:1783947520.749873:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 225 00000100:00100000:3.0:1783947520.749888:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+60:12453:x1870604214043776:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:3.0:1783947520.750704:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.750732:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.751009:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947520.751082:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1783947520.751111:0:6510:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b4d6b39d reply state 00000000374edbd6 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.751127:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.751159:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947520.751162:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947520.751166:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947520.751353:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+63:12453:x1870604214043776:12345-192.168.204.3@tcp:36:bash.0 Request processed in 1454us (2089us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1783947520.751364:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 225 00000020:00080000:3.0:1783947520.751372:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783947520.755714:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236114048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947520.755843:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947520.755950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236114048 00000100:00100000:2.0:1783947520.755961:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236114048 00000100:00100000:2.0:1783947520.756613:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783947520.756627:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236114048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947520.756680:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947520.757080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236114048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 454us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.757090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783947520.757185:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236114048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947520.761708:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.761861:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214043904 00000100:00100000:1.0:1783947520.761875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214043904 00000100:00100000:1.0:1783947520.762073:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 226 00000100:00100000:1.0:1783947520.762086:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+63:12453:x1870604214043904:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947520.762135:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947520.762190:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501081 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.762332:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.762361:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.762373:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.762418:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.762433:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 64 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.762451:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236114176:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947520.762679:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947520.769366:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236114176:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947520.769415:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947520.772557:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.773416:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214044032 00000100:00100000:2.0:1783947520.773436:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214044032 00010000:00010000:2.0:1783947520.773557:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 65 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947520.773604:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 101 00000100:00100000:2.0:1783947520.773617:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+65:2407:x1870604214044032:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947520.773658:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947520.773667:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 65 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.773684:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 65 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.773721:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb5550105e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41c6 expref: 65 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.773746:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947520.773750:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.773762:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.773770:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.773801:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947520.773890:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+64:2407:x1870604214044032:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 276us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.773898:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 101 00010000:00010000:1.0:1783947520.774173:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.774184:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947520.774279:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783947520.774284:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947520.774319:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.774377:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501081 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.774399:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.774409:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947520.774413:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947520.774416:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55400, rc 0) 00000100:00100000:1.0:1783947520.774520:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+63:12453:x1870604214043904:12345-192.168.204.3@tcp:101:bash.0 Request processed in 12375us (12767us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947520.774529:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 226 00000100:00100000:0.0:1783947520.778762:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.778882:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214044288 00000100:00100000:1.0:1783947520.778896:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214044288 00000100:00100000:1.0:1783947520.778981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:1.0:1783947520.778994:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+63:12453:x1870604214044288:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:1.0:1783947520.779319:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+64:12453:x1870604214044288:12345-192.168.204.3@tcp:35:bash.0 Request processed in 327us (572us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1783947520.779328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:3.0:1783947520.860836:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.860988:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214044416 00000100:00100000:2.0:1783947520.861001:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214044416 00000100:00100000:2.0:1783947520.861084:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 227 00000100:00100000:2.0:1783947520.861097:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+64:12459:x1870604214044416:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947520.861159:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947520.861188:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb5550108f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41db expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.861282:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501096 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.861309:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.861324:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947520.861397:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783947520.861402:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947520.861675:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.861710:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb5550108f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41db expref: 66 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.861730:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41db expref: 65 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.861740:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947520.861742:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947520.861746:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b200, rc 0) 00000100:00100000:2.0:1783947520.861810:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+65:12459:x1870604214044416:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 716us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.861817:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 227 00000100:00100000:2.0:1783947520.868703:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947520.868987:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214044544 00000100:00100000:3.0:1783947520.869002:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214044544 00000100:00100000:3.0:1783947520.869094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 228 00000100:00100000:3.0:1783947520.869106:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+65:12459:x1870604214044544:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947520.869137:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947520.869166:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb5550109d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41e2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869268:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869288:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869302:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869314:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869321:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869359:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869630:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869642:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869651:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947520.869713:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783947520.869719:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947520.869745:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869760:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869771:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869779:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869786:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869793:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947520.869798:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869815:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.869989:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947520.869993:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947520.869999:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870006:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870026:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870032:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870039:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870044:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947520.870048:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870055:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870063:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:3.0:1783947520.870066:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947520.870069:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870087:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870138:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb5550109d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870153:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.870161:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947520.870164:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947520.870167:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50600, rc 0) 00000100:00100000:3.0:1783947520.870741:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+66:12459:x1870604214044544:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 1633us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947520.870751:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 228 00000100:00100000:0.0:1783947520.880011:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.880069:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947520.880188:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214044928 00000100:00100000:1.0:1783947520.880201:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214044928 00000100:00100000:1.0:1783947520.880302:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 229 00000100:00100000:1.0:1783947520.880315:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+66:12459:x1870604214044928:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947520.880358:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947520.880389:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb555010b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41e9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.880585:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.880605:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.880614:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.880630:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.880678:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.880695:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 67 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.880713:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236114304:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947520.880853:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.880879:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 67 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.880889:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236114432:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947520.880919:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947520.882694:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214044672 00000100:00100000:3.0:1783947520.882711:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214044672 00010000:00010000:3.0:1783947520.882771:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 68 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947520.882829:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 102 00000100:00100000:3.0:1783947520.882840:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+68:2409:x1870604214044672:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947520.882859:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947520.882868:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 68 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.882906:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 68 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.882937:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947520.882943:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.882953:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.882960:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947520.883132:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+68:2409:x1870604214044672:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 294us (3135us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947520.883142:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 102 00010000:00010000:1.0:1783947520.885558:0:6511:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.3@tcp) returned -22 from blocking AST (req@000000009255e626 x1870604236114304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 67 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.885591:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e2 expref: 67 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947520.885614:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236114304:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947520.886799:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1870604236114432:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947520.886902:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947520.886910:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.886923:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.886934:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947520.887096:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947520.887199:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214045056 00000100:00100000:0.0:1783947520.887209:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214045056 00010000:00010000:0.0:1783947520.887258:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 67 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947520.887306:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 103 00000100:00100000:0.0:1783947520.887318:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+67:2406:x1870604214045056:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947520.887337:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947520.887354:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 67 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.887369:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 67 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.887397:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55400/0xe6fd1fdb55501088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41d4 expref: 67 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.887413:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:0.0:1783947520.887416:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.887426:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.887495:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947520.887528:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947520.887597:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+66:2406:x1870604214045056:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 281us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947520.887605:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 103 00010000:00010000:1.0:1783947520.887729:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.887747:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947520.887770:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783947520.887952:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb555010b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.887971:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947520.887979:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947520.887981:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947520.887984:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55800, rc 0) 00000100:00100000:1.0:1783947520.888015:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+66:12459:x1870604214044928:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 7703us (7945us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1783947520.888023:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 229 00000100:00100000:0.0:1783947520.891315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.891397:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214045312 00000100:00100000:2.0:1783947520.891410:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214045312 00000100:00100000:2.0:1783947520.891722:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:2.0:1783947520.891736:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+66:12459:x1870604214045312:12345-192.168.204.3@tcp:103:lfs.0 00010000:00010000:2.0:1783947520.891757:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947520.891789:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501011 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41b8 expref: 66 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.891811:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947520.891816:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947520.892080:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+65:12459:x1870604214045312:12345-192.168.204.3@tcp:103:lfs.0 Request processed in 340us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.892088:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:0.0:1783947520.893966:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947520.894020:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214045440 00000100:00100000:2.0:1783947520.894032:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214045440 00000100:00100000:2.0:1783947520.894101:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 230 00000100:00100000:2.0:1783947520.894113:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+65:12459:x1870604214045440:12345-192.168.204.3@tcp:58:lfs.0 00010000:00010000:2.0:1783947520.894266:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.894286:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947520.894299:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947520.894453:0:8291:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1783947520.894611:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+65:12459:x1870604214045440:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 500us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947520.894620:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 230 00000100:00100000:0.0:1783947520.900388:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947520.900520:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214045568 00000100:00100000:3.0:1783947520.900536:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214045568 00000100:00100000:3.0:1783947520.900614:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 231 00000100:00100000:3.0:1783947520.900626:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+65:12459:x1870604214045568:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947520.900656:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947520.900686:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41f0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.900761:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.900775:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.900836:0:6510:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.900853:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.900870:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947520.900873:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947520.900877:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947520.900885:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51800, rc 0) 00000100:00100000:3.0:1783947520.900961:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+66:12459:x1870604214045568:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 338us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947520.900969:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 231 00010000:00010000:3.0:1783947521.204880:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947521.331988:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947521.332001:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947521.332034:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1783947521.332047:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783947521.332531:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236114560:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947521.333052:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947521.338316:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236114560:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783947521.341790:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.341898:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214045696 00000100:00100000:2.0:1783947521.341910:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214045696 00000100:00100000:2.0:1783947521.341977:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00100000:2.0:1783947521.341987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4c83050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+66:12460:x1870604214045696:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947521.342031:0:6511:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947521.342200:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4c83050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+66:12460:x1870604214045696:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 213us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.342208:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 232 00000100:00100000:0.0:1783947521.354739:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.354844:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214045824 00000100:00100000:3.0:1783947521.354858:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214045824 00000100:00100000:3.0:1783947521.354949:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 233 00000100:00100000:3.0:1783947521.354980:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+66:12460:x1870604214045824:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783947521.355079:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355102:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355116:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355134:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355143:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355149:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355180:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355191:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355198:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947521.355259:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783947521.355264:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947521.355282:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355306:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355313:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355320:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355327:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947521.355344:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355353:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355369:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:3.0:1783947521.355372:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947521.355378:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355386:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb555010dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355404:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355410:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355416:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355428:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947521.355431:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355438:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355447:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9e7bc8a89600) 00010000:00010000:3.0:1783947521.355449:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947521.355452:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355501:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb555010e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355520:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355526:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355531:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355537:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:3.0:1783947521.355540:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355546:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355565:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947521.355568:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947521.355571:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.355577:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb555010ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947521.355682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+66:12460:x1870604214045824:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 703us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.355691:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 233 00000100:00100000:0.0:1783947521.364978:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.365526:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214046080 00000100:00100000:2.0:1783947521.365540:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214046080 00000100:00100000:2.0:1783947521.365622:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 234 00000100:00100000:2.0:1783947521.365634:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+66:12460:x1870604214046080:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947521.365664:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947521.365692:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb555010f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41f7 expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.366368:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.366391:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.366406:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947521.366421:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783947521.367100:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367113:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367120:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367127:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846bc00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947521.367131:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367140:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367157:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947521.367160:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783947521.367165:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367172:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb555010f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367229:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb555010f1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f7 expref: 68 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367240:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:2.0:1783947521.367243:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947521.367246:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb555010f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f7 expref: 68 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.367269:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846be00, rc 0) 00000100:00100000:2.0:1783947521.367368:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+67:12460:x1870604214046080:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1736us (2405us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1783947521.367379:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 234 00000100:00100000:1.0:1783947521.375384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.376006:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214046208 00000100:00100000:2.0:1783947521.376021:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214046208 00000100:00100000:2.0:1783947521.376160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 235 00000100:00100000:2.0:1783947521.376173:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+67:12460:x1870604214046208:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947521.376434:0:6511:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947521.380669:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+67:12460:x1870604214046208:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 4480us (5283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.380689:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 235 00000100:00100000:0.0:1783947521.394635:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.395343:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214046464 00000100:00100000:3.0:1783947521.395358:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214046464 00000100:00100000:3.0:1783947521.395891:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 236 00000100:00100000:3.0:1783947521.395908:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+67:12460:x1870604214046464:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947521.395938:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947521.395942:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783947521.395980:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501096 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41db expref: 67 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.395999:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947521.396005:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947521.396185:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55501106 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e41fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783947521.396982:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1783947521.398817:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb5550110d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.398847:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb5550110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.398862:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb5550110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.399081:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50600/0xe6fd1fdb55501106 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41fe expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.399112:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb5550110d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41fe expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.399148:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e100) 00010000:00010000:2.0:1783947521.399152:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783947521.399157:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846be00, rc 0) 00000100:00100000:2.0:1783947521.399367:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+68:12460:x1870604214046464:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 3461us (4745us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1783947521.399378:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 236 00000100:00100000:0.0:1783947521.413235:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.413308:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214046720 00000100:00100000:2.0:1783947521.413327:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214046720 00000100:00100000:2.0:1783947521.413417:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 237 00000100:00100000:2.0:1783947521.413429:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+68:12460:x1870604214046720:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947521.413544:0:12193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947521.413657:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb5550110d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41fe expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413678:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e100) 00010000:00010000:2.0:1783947521.413690:0:12193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783947521.413711:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413726:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413737:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413752:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413778:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413786:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413833:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413840:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413846:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413852:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846bc00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947521.413856:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413864:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413871:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:2.0:1783947521.413874:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947521.413879:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413885:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb5550111b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413894:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413971:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413979:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413984:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947521.413987:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.413994:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.414002:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xa9326115 (ffff9e7ac761e500) 00010000:00010000:2.0:1783947521.414005:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947521.414009:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.414015:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501122 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xa9326115 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.414288:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+67:12460:x1870604214046720:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 859us (1066us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947521.414297:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 237 00000100:00100000:1.0:1783947521.421025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.421419:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214046848 00000100:00100000:2.0:1783947521.421433:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214046848 00000100:00100000:2.0:1783947521.421564:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 238 00000100:00100000:2.0:1783947521.421576:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+67:12460:x1870604214046848:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947521.421607:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947521.421663:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501129 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4205 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.421711:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.421728:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.421743:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.421884:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb55501129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.421907:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.421917:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:2.0:1783947521.421920:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783947521.421924:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:2.0:1783947521.422002:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+68:12460:x1870604214046848:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 428us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.422010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 238 00000100:00100000:0.0:1783947521.426986:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.427158:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214047104 00000100:00100000:2.0:1783947521.427172:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214047104 00000100:00100000:2.0:1783947521.427246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 239 00000100:00100000:2.0:1783947521.427258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+68:12460:x1870604214047104:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783947521.429986:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.430039:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.430055:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947521.430288:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1783947521.430300:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 406657842727ns, next at 407657839562ns, rc = 0 00000004:00010000:2.0:1783947521.432230:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017d5dc52 reply state 00000000449fc3ea transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.432264:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.432275:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:2.0:1783947521.432279:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783947521.432284:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783947521.433853:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+70:12460:x1870604214047104:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 6581us (6876us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783947521.433869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 239 00000100:00100000:0.0:1783947521.441019:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.441095:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214047232 00000100:00100000:3.0:1783947521.441128:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214047232 00000100:00100000:3.0:1783947521.441218:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:3.0:1783947521.441231:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+70:12460:x1870604214047232:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947521.441276:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947521.441304:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e420c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.441398:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 71 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.441416:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 71 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.441440:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:3.0:1783947521.441444:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947521.441449:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51600, rc 0) 00000100:00100000:3.0:1783947521.441573:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+71:12460:x1870604214047232:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 344us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.441581:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 240 00000100:00100000:1.0:1783947521.445415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.447301:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214047360 00000100:00100000:0.0:1783947521.447323:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214047360 00000100:00100000:0.0:1783947521.447531:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:0.0:1783947521.447548:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604214047360:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783947521.447870:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947521.448512:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+10:2406:x1870604214047360:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 965us (3254us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1783947521.448524:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:0.0:1783947521.452499:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947521.452599:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214047616 00000100:00100000:1.0:1783947521.452614:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214047616 00000100:00100000:1.0:1783947521.452687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:1.0:1783947521.452698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+71:12460:x1870604214047616:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783947521.453111:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+72:12460:x1870604214047616:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 412us (665us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1783947521.453140:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:2.0:1783947521.456126:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.456283:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214047872 00000100:00100000:3.0:1783947521.456296:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214047872 00000100:00100000:3.0:1783947521.456387:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:3.0:1783947521.456400:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+72:12460:x1870604214047872:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947521.456596:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+72:12460:x1870604214047872:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 198us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.456605:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 241 00000100:00100000:2.0:1783947521.459811:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.460554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214048000 00000100:00100000:0.0:1783947521.460570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214048000 00000100:00100000:0.0:1783947521.460715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:0.0:1783947521.463016:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+72:12460:x1870604214048000:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947521.463049:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947521.463082:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55501145 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4213 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.463182:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550114c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.463201:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550114c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.463216:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550114c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947521.464438:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947521.464615:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550114c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.464673:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b200/0xe6fd1fdb55501145 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4213 expref: 74 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.464700:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550114c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4213 expref: 73 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.464711:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:0.0:1783947521.464715:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783947521.464719:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:0.0:1783947521.465109:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+73:12460:x1870604214048000:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 2114us (5648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.465142:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 242 00000100:00100000:2.0:1783947521.469730:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.469820:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214048128 00000100:00100000:0.0:1783947521.469833:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214048128 00000100:00100000:0.0:1783947521.469905:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:0.0:1783947521.469916:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+10:2407:x1870604214048128:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947521.469941:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947521.469967:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e421a expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947521.469999:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e100, blocks: 0x0 00010000:00010000:0.0:1783947521.470028:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1783947521.470033:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947521.470045:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.470066:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.470083:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ba00, rc 0) 00000100:00100000:0.0:1783947521.470180:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+11:2407:x1870604214048128:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 265us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.470187:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:2.0:1783947521.473918:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947521.474008:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214048384 00000100:00100000:1.0:1783947521.474021:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214048384 00000100:00100000:1.0:1783947521.474104:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:1.0:1783947521.474116:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+73:12460:x1870604214048384:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783947521.474284:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+73:12460:x1870604214048384:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 170us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.474292:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 243 00000100:00100000:2.0:1783947521.478251:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.478516:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214048512 00000100:00100000:0.0:1783947521.478529:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214048512 00000100:00100000:0.0:1783947521.478597:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:0.0:1783947521.478609:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+11:12460:x1870604214048512:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947521.478651:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947521.478677:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4221 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.478719:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.478731:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947521.478735:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947521.478742:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.478787:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.478802:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 12 pid: 8429 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947521.478832:0:8539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1870604236114688:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947521.478959:0:8539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947521.483089:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.483218:0:8539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1870604236114688:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947521.483265:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.483292:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b200, rc 0) 00000100:00100000:0.0:1783947521.483397:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+12:12460:x1870604214048512:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 4790us (5173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.483409:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:3.0:1783947521.484207:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214048640 00000100:00100000:3.0:1783947521.484229:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214048640 00010000:00010000:3.0:1783947521.484277:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 12 pid: 8429 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947521.484321:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 104 00000100:00100000:3.0:1783947521.484343:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+12:2406:x1870604214048640:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947521.484359:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947521.484390:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 12 pid: 8429 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.484403:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 12 pid: 8429 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.484440:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025dae08d/0xe6fd1fdb55501153 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e421a expref: 12 pid: 8429 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.484609:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947521.484615:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947521.484625:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.484638:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.484684:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947521.484712:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1870604236114816:192.168.204.3@tcp:105: 00000100:00100000:3.0:1783947521.485017:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783947521.490436:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.490706:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214048768 00000100:00100000:0.0:1783947521.490722:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214048768 00002000:00100000:0.0:1783947521.490790:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9e7ac8620e00 x1870604214048768/t0(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:312/0 lens 504/0 e 0 to 0 dl 1783947532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947521.490803:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac8620e00 with x1870604214048768 ext(0->12) 00002000:00010000:0.0:1783947521.490811:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac8620e00 00000100:00100000:0.0:1783947521.490855:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:0.0:1783947521.490866:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+12:2406:x1870604214048768:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783947521.491235:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1870604236114816:192.168.204.3@tcp:105: 00010000:00010000:3.0:1783947521.491266:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947521.491956:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+14:2406:x1870604214048640:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 7621us (8875us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.491977:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 104 00000100:00100000:0.0:1783947521.492314:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1eb923ac-790a-478f-897e-124614dbce09+13:2406:x1870604214048768:12345-192.168.204.3@tcp:4:lhsmtool_posix.0 Request processed in 1446us (1891us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783947521.492324:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00002000:00100000:0.0:1783947521.492411:0:8433:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9e7ac8620e00 x1870604214048768/t4294967321(0) o4->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:312/0 lens 504/448 e 0 to 0 dl 1783947532 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947521.492423:0:8433:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7ac8620e00 with x1870604214048768 ext(0->12) 00002000:00010000:0.0:1783947521.492429:0:8433:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7ac8620e00 00000100:00100000:1.0:1783947521.495231:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.495381:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214048896 00000100:00100000:0.0:1783947521.495395:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214048896 00000100:00100000:0.0:1783947521.495492:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00100000:0.0:1783947521.495503:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+73:12460:x1870604214048896:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783947521.499139:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1783947521.499160:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1783947521.499213:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:1.0:1783947521.499350:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499366:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499376:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499383:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ba00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.499389:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499398:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499422:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9e7c003e5b00) 00010000:00010000:1.0:1783947521.499425:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.499431:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499493:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb55500e5f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499541:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499548:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499554:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499560:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.499564:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499570:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499580:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9e7bc8a89d00) 00010000:00010000:1.0:1783947521.499583:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.499586:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499593:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb55500f07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499613:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499620:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.499631:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236114944:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783947521.499637:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499649:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.499652:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499657:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499664:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:1.0:1783947521.499666:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.499669:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499675:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55500f85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499702:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499708:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499714:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499719:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.499721:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499736:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.499737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947521.499748:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:1.0:1783947521.499751:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.499754:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499760:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51e00/0xe6fd1fdb55500fa8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499780:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499787:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499792:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499798:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.499801:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499807:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499815:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947521.499817:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.499820:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499834:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51200/0xe6fd1fdb5550107a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499849:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499855:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499867:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499872:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846be00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.499875:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499880:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499888:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:1.0:1783947521.499890:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947521.499892:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.499897:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501137 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783947521.500001:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7bc7f9e780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1783947521.500006:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bc65a9800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bc7f9e3c0 00000020:00080000:3.0:1783947521.500010:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bc65a9100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac7731c00 00000020:00080000:2.0:1783947521.500058:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:3.0:1783947521.500385:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1783947521.500420:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7bd1a62000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1783947521.500424:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7be78a5100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bd1a62780 00000020:00080000:3.0:1783947521.500427:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7be78a5b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac5aeb000 00000020:00080000:2.0:1783947521.500475:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1783947521.500550:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783947521.500714:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947521.500729:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236115200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783947521.500791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947521.500838:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236114944 00000100:00100000:0.0:1783947521.500847:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236114944 00000100:00100000:0.0:1783947521.500912:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236115200 00000100:00100000:0.0:1783947521.500915:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236115200 00000100:00100000:0.0:1783947521.500943:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783947521.500952:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3639:x1870604236114944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783947521.500989:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1783947521.501032:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a54e0ff, atime: 0x6a54e0ff, ctime: 0x6a54e0ff, blocks: 0x8 00010000:00010000:0.0:1783947521.501040:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.501060:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1783947521.501066:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783947521.501521:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947521.501537:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236115072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783947521.501583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947521.501988:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+21:12460:x1870604214048896:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 6483us (6766us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.501999:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 244 00000100:00080000:1.0:1783947521.502530:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947521.502537:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947521.502553:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236115072 00000100:00100000:1.0:1783947521.502560:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236115072 00000100:00100000:1.0:1783947521.502612:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947521.502621:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236115200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1783947521.502772:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783947521.502776:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783947520 00002000:00010000:1.0:1783947521.502778:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783947521.502780:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783947520 -> 1783947520 00002000:00010000:1.0:1783947521.502783:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1783947521.502848:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3638:x1870604236115200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (2055us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1783947521.502855:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947521.502872:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783947521.502879:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3639:x1870604236115072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783947521.502896:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1783947521.502917:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.502938:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.502947:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783947521.502951:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947521.502956:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.502993:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.503022:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 12 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947521.503037:0:8429:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1870604236115328:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947521.503099:0:8429:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1783947521.503351:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.503377:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.503388:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.503397:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.503424:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783947521.503611:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3639:x1870604236114944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2658us (3874us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783947521.503620:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1783947521.503678:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7ac8621c00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1783947521.503685:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236114944:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1783947521.503796:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7bc9429500/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783947521.503802:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236115200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783947521.504543:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.505400:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214049024 00000100:00100000:0.0:1783947521.505413:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214049024 00000100:00100000:0.0:1783947521.505516:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:0.0:1783947521.505529:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+13:2407:x1870604214049024:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1783947521.506124:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947521.506137:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.506154:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ba00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947521.506159:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.506173:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.506204:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.506213:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025dae08d/0xe6fd1fdb55501161 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.506452:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947521.506479:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947521.506493:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947521.510851:0:8429:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1870604236115328:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947521.510903:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.511190:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.511286:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214049152 00000100:00100000:3.0:1783947521.511306:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214049152 00010000:00010000:3.0:1783947521.511365:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 14 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947521.511416:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 105 00000100:00100000:3.0:1783947521.511427:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+14:2406:x1870604214049152:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947521.511446:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947521.511453:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 14 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.511680:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 14 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.511711:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa67b088/0xe6fd1fdb55500f15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4179 expref: 14 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.511731:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947521.511736:0:7462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947521.511744:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.511755:0:7462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.511791:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947521.511913:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+13:2406:x1870604214049152:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 486us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.511934:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 105 00010000:00010000:1.0:1783947521.511995:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.512005:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.512016:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.512025:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.512044:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783947521.512289:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3639:x1870604236115072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9409us (10703us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783947521.512301:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1783947521.512382:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947521.512393:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.512402:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947521.512407:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.512417:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.512433:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.512441:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b07c2d6/0xe6fd1fdb55501168 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.512512:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947521.512515:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947521.512517:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783947521.512780:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7bc9428a80/2, rc 0, transno 4294967323 00000100:00100000:3.0:1783947521.512789:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236115072:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1783947521.519591:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1783947521.519612:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1783947521.520354:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214049024:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 14815us (15802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.520370:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 76 00000100:00100000:2.0:1783947521.524125:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.524363:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214049408 00000100:00100000:0.0:1783947521.524378:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214049408 00000100:00100000:0.0:1783947521.524561:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:0.0:1783947521.524575:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+21:12460:x1870604214049408:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783947521.524651:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947521.524690:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550114c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4213 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.524713:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:0.0:1783947521.524719:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947521.524759:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.524778:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.524791:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947521.524961:0:6512:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f01d4484 reply state 00000000c02d4de7 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.524998:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.525004:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:0.0:1783947521.525007:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947521.525011:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947521.527598:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+22:12460:x1870604214049408:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 3008us (3470us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1783947521.527615:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 245 00000100:00100000:1.0:1783947521.529652:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.529913:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214049536 00000100:00100000:0.0:1783947521.529926:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214049536 00000100:00100000:0.0:1783947521.530009:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:0.0:1783947521.530023:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bef960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2409:x1870604214049536:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783947521.530216:0:10351:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783947521.530220:0:10351:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1783947520 -> 1783947519 00002000:00010000:0.0:1783947521.530222:0:10351:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783947519 00002000:00010000:0.0:1783947521.530224:0:10351:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783947520 -> 1783947519 00002000:00010000:0.0:1783947521.530225:0:10351:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1783947521.530290:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bef960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+8:2409:x1870604214049536:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 271us (656us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783947521.530296:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 77 00000100:00100000:2.0:1783947521.536179:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.536362:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214049792 00000100:00100000:3.0:1783947521.536376:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214049792 00000100:00100000:3.0:1783947521.536503:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 246 00000100:00100000:3.0:1783947521.536515:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+22:12460:x1870604214049792:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783947521.536612:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.536636:0:8291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.536646:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.536691:0:8291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947521.536707:0:8291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 22 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947521.536725:0:8291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236115456:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947521.540228:0:8291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1783947521.547833:0:8291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236115456:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947521.547877:0:8291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.549185:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.549513:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214049920 00000100:00100000:0.0:1783947521.549526:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214049920 00010000:00010000:0.0:1783947521.549580:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 23 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947521.549634:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 106 00000100:00100000:0.0:1783947521.549662:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+23:2407:x1870604214049920:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947521.549684:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947521.549693:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 23 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.549708:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 23 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.549736:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501130 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4205 expref: 23 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.549756:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:0.0:1783947521.549774:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.549787:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.549796:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.549840:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947521.549912:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1eb923ac-790a-478f-897e-124614dbce09+22:2407:x1870604214049920:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 252us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.549921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 106 00010000:00010000:1.0:1783947521.550172:0:8291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550182:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550247:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550256:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550276:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550283:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.550289:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550299:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550310:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:1.0:1783947521.550313:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783947521.550317:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.550323:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50200/0xe6fd1fdb55501176 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947521.550401:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+21:12460:x1870604214049792:12345-192.168.204.3@tcp:55:lhsmtool_posix.0 Request processed in 13887us (14239us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783947521.550412:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 246 00000100:00100000:2.0:1783947521.556507:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.556598:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214050048 00000100:00100000:3.0:1783947521.556615:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214050048 00000100:00100000:2.0:1783947521.556748:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1783947521.556771:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214050048:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783947521.556842:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.556871:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.556904:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947521.556910:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947521.556917:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.556981:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.556998:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 8 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.557017:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1870604236115584:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947521.557482:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f3b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947521.563916:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8427:1870604236115584:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947521.564152:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.564365:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214050176 00000100:00100000:3.0:1783947521.564420:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214050176 00010000:00010000:3.0:1783947521.564605:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 9 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.565373:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 107 00000100:00100000:2.0:1783947521.565395:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+9:2406:x1870604214050176:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947521.565419:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947521.565454:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 9 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.565499:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 9 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.565530:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442c7c76/0xe6fd1fdb5550115a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4221 expref: 9 pid: 8539 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.565573:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947521.565579:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783947521.565586:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.565597:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.565625:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947521.565711:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2406:x1870604214050176:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 326us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.565721:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 107 00010000:00010000:0.0:1783947521.568553:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568622:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568632:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568673:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568683:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568693:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568702:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ac00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947521.568707:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568717:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568741:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.568762:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb5550117d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947521.568910:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1eb923ac-790a-478f-897e-124614dbce09+7:2406:x1870604214050048:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 12146us (12455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.568922:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 78 00000100:00100000:2.0:1783947521.572680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.572776:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214050432 00000100:00100000:0.0:1783947521.572789:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214050432 00000100:00100000:0.0:1783947521.572857:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 247 00000100:00100000:0.0:1783947521.572869:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+21:12460:x1870604214050432:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783947521.572984:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.573009:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 21 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.573022:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.573070:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 21 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.573088:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 21 pid: 8291 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947521.573126:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236115712:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947521.573507:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947521.580621:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.581026:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214050560 00000100:00100000:2.0:1783947521.581039:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214050560 00010000:00010000:2.0:1783947521.581098:0:7462:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 22 pid: 8291 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.581158:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 108 00000100:00100000:2.0:1783947521.581171:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+22:2407:x1870604214050560:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947521.581192:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947521.581201:0:7462:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 22 pid: 8291 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.581216:0:7462:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 22 pid: 8291 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.581280:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947521.581287:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.581300:0:7462:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.581310:0:7462:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.581319:0:7462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.581356:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947521.581515:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501073 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41cd expref: 22 pid: 8291 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947521.581538:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236115712:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947521.581564:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.581575:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.581581:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.581680:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+21:2407:x1870604214050560:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 509us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.581690:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 108 00010000:00010000:0.0:1783947521.581893:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.581908:0:12193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.581918:0:12193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.581955:0:12193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947521.581972:0:12193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 21 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947521.581987:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236115840:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947521.582059:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947521.588987:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.589190:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236115840:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947521.589232:0:12193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947521.589393:0:9516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214050688 00000100:00100000:1.0:1783947521.589404:0:9516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214050688 00010000:00010000:1.0:1783947521.589506:0:9516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947521.589553:0:9516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 109 00000100:00100000:1.0:1783947521.589565:0:9516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+22:2407:x1870604214050688:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947521.589613:0:9516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947521.589623:0:9516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.589638:0:9516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.589669:0:9516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51600/0xe6fd1fdb5550113e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e420c expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.589688:0:9516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:1.0:1783947521.589694:0:9516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.589706:0:9516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.589715:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.589742:0:9516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947521.589817:0:9516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1eb923ac-790a-478f-897e-124614dbce09+21:2407:x1870604214050688:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 254us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.589825:0:9516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 109 00010000:00010000:2.0:1783947521.589920:0:12193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.589928:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783947521.590081:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1783947521.590226:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1783947521.590360:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1783947521.590522:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236115968:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783947521.590590:0:12193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947521.590633:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1783947521.590805:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236115968 00000100:00100000:0.0:1783947521.590812:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236115968 00000100:00100000:0.0:1783947521.590866:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783947521.590876:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12193:x1870604236115968:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783947521.590976:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12193:x1870604236115968:12345-0@lo:1000:mdt00_004.0 Request processed in 102us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.590983:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1783947521.591027:0:12193:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1783947521.591034:0:12193:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1783947521.591070:0:12193:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7bc9429500, transno 4294967322 00000100:00100000:0.0:1783947521.591087:0:12193:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9e7bc9428a80 x1870604236115072/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783947537 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947521.591101:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236115968:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1783947521.591487:0:12193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1783947521.591552:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236116096:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783947521.591594:0:12193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947521.591616:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947521.592119:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236116096 00000100:00100000:2.0:1783947521.592128:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236116096 00000100:00100000:2.0:1783947521.592182:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783947521.592193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12193:x1870604236116096:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783947521.592552:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12193:x1870604236116096:12345-0@lo:1000:mdt00_004.0 Request processed in 360us (956us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783947521.592560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783947521.592679:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12193:1870604236116096:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1783947521.592731:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592744:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592768:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592775:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.592780:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592790:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592811:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:1.0:1783947521.592814:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783947521.592820:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592827:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b800/0xe6fd1fdb5550118b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592858:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592864:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592869:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592874:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.592876:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592892:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592902:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947521.592905:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783947521.592912:0:12193:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592925:0:12193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592935:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.592974:0:12193:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947521.592988:0:12193:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236116224:192.168.204.3@tcp:105: 00000100:00100000:1.0:1783947521.593076:0:12193:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947521.597655:0:12193:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12193:1870604236116224:192.168.204.3@tcp:105: 00010000:00010000:1.0:1783947521.597702:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597715:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b400/0xe6fd1fdb555010ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597760:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597795:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597808:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597822:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597829:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597836:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597842:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.597847:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597856:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597869:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947521.597872:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.597877:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597883:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501192 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597894:0:12193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597905:0:12193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597912:0:12193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597917:0:12193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.597920:0:12193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597927:0:12193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597936:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947521.597939:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947521.597942:0:12193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.597948:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501184 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947521.598181:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+24:12460:x1870604214050432:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 25312us (25514us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1783947521.598193:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 247 00000020:00080000:1.0:1783947521.598202:0:12193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783947521.598366:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000040:00080000:0.0:1783947521.599089:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947521.599097:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947521.599780:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783947521.599796:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783947521.600133:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214050816 00000100:00100000:1.0:1783947521.600144:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214050816 00000100:00100000:1.0:1783947521.600209:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:1.0:1783947521.600221:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+24:12459:x1870604214050816:12345-192.168.204.3@tcp:49:lfs.0 00000100:00100000:1.0:1783947521.600895:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+24:12459:x1870604214050816:12345-192.168.204.3@tcp:49:lfs.0 Request processed in 212us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.600908:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:3.0:1783947521.608948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947521.609099:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947521.609560:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214051072 00000100:00100000:0.0:1783947521.609588:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214051072 00000100:00100000:0.0:1783947521.609673:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 248 00000100:00100000:0.0:1783947521.609687:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+24:12459:x1870604214051072:12345-192.168.204.3@tcp:58:lfs.0 00000040:00080000:0.0:1783947521.609927:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1783947521.610039:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+24:12459:x1870604214051072:12345-192.168.204.3@tcp:58:lfs.0 Request processed in 355us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947521.610047:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 248 00000100:00100000:1.0:1783947521.614732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214051328 00000100:00100000:1.0:1783947521.614756:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214051328 00000100:00100000:1.0:1783947521.614915:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:1.0:1783947521.614927:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+24:12460:x1870604214051328:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783947521.615304:0:6514:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783947521.615355:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1783947521.615403:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.615425:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.615452:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.615506:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.615513:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.615521:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.615539:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783947521.615684:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+26:12460:x1870604214051328:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 756us (6582us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1783947521.615716:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000020:00080000:1.0:1783947521.615724:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783947521.615846:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947521.615856:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.615864:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947521.615869:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.615878:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.615895:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:2.0:1783947521.615898:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783947521.615904:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.615910:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb55501199 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.615931:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947521.615933:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947521.615934:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947521.646577:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947521.647168:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214051456 00000100:00100000:1.0:1783947521.647185:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214051456 00000100:00100000:1.0:1783947521.647285:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 249 00000100:00100000:1.0:1783947521.647297:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+26:12462:x1870604214051456:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947521.647342:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947521.647373:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555011a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4228 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647509:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647528:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647543:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647560:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647567:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647574:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647664:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647701:0:8291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.647711:0:8291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.648130:0:8291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.648150:0:8291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 27 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947521.648167:0:8291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236116352:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947521.648440:0:8291:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947521.657155:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947521.657558:0:8291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8291:1870604236116352:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947521.657601:0:8291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947521.659884:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214051712 00000100:00100000:0.0:1783947521.659904:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214051712 00000100:00100000:0.0:1783947521.660034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:0.0:1783947521.660047:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+28:6177:x1870604214051712:12345-192.168.204.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783947521.660386:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+29:6177:x1870604214051712:12345-192.168.204.3@tcp:35:ldlm_bl.0 Request processed in 340us (3244us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1783947521.660395:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:3.0:1783947521.665012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947521.665137:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214051840 00000100:00100000:2.0:1783947521.665168:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214051840 00010000:00010000:2.0:1783947521.665219:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 29 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.665270:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 110 00000100:00100000:2.0:1783947521.665281:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+29:2406:x1870604214051840:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947521.665309:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947521.665318:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 29 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.665342:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 29 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.665370:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb555010c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41e9 expref: 29 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.665392:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947521.665398:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.665410:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.665428:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947521.665514:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947521.665538:0:8291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665551:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947521.665580:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1eb923ac-790a-478f-897e-124614dbce09+28:2406:x1870604214051840:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 300us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.665598:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 110 00000004:00200000:1.0:1783947521.665626:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783947521.665633:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947521.665662:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665691:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665703:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665711:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665719:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665726:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.665731:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665741:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665752:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:1.0:1783947521.665756:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.665761:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665768:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55000/0xe6fd1fdb555011a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665780:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665786:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665798:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665804:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947521.665807:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665814:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665825:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9e7be782f000) 00010000:00010000:1.0:1783947521.665828:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947521.665832:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.665838:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55600/0xe6fd1fdb555011ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.667413:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54e00/0xe6fd1fdb555011a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4228 expref: 28 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.667453:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4228 expref: 27 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947521.667476:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947521.667479:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947521.667483:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54000, rc 0) 00000100:00100000:1.0:1783947521.667570:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+27:12462:x1870604214051456:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 20275us (21010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.667600:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 249 00000100:00100000:1.0:1783947521.780516:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236116480:0@lo:400:kworker.0 00000100:00100000:3.0:1783947521.780554:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236116864:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.780626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.780688:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236116992:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.780900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.780928:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236117504:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.780959:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.780978:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236118016:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.781058:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236116608:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.781110:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236117120:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.781148:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236117632:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.781190:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783947521.781197:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236116736:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.781238:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236117248:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781259:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.781278:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236117760:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.781355:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236116480 00000100:00100000:1.0:1783947521.781377:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236116480 00000100:00100000:1.0:1783947521.781440:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1783947521.781450:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236116480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781558:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236116480:12345-0@lo:400:kworker.0 Request processed in 109us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.781566:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1783947521.781607:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236116992 00000100:00100000:1.0:1783947521.781611:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236116992 00000100:00100000:1.0:1783947521.781632:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236116736 00000100:00100000:1.0:1783947521.781635:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236116736 00000100:00100000:1.0:1783947521.781647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783947521.781652:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236116992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781686:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236116992:12345-0@lo:400:kworker.0 Request processed in 34us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.781692:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783947521.781703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783947521.781709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236116736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.781753:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236116736:12345-0@lo:400:kworker.0 Request processed in 44us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.781758:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783947521.782436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947521.782745:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236117376:0@lo:400:kworker.0 00000100:00100000:3.0:1783947521.782786:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947521.782807:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236117888:0@lo:400:kworker.0 00000100:00100000:3.0:1783947521.782830:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947521.782931:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236116608 00000100:00100000:3.0:1783947521.782938:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236116608 00000100:00100000:3.0:1783947521.782977:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236117120 00000100:00100000:3.0:1783947521.782980:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236117120 00000100:00100000:3.0:1783947521.783020:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236117632 00000100:00100000:3.0:1783947521.783024:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236117632 00000100:00100000:3.0:1783947521.783054:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236117248 00000100:00100000:3.0:1783947521.783057:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236117248 00000100:00100000:3.0:1783947521.783070:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236117760 00000100:00100000:3.0:1783947521.783073:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236117760 00000100:00100000:3.0:1783947521.783086:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236116864 00000100:00100000:3.0:1783947521.783088:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236116864 00000100:00100000:3.0:1783947521.783102:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1783947521.783109:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236116608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947521.783154:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236116608:12345-0@lo:400:kworker.0 Request processed in 46us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.783160:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1783947521.783172:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783947521.783175:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236117120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947521.783191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236117120:12345-0@lo:400:kworker.0 Request processed in 16us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.783195:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783947521.783202:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783947521.783207:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236117632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947521.783224:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236117632:12345-0@lo:400:kworker.0 Request processed in 18us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.783228:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783947521.783236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1783947521.783240:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236117504 00000100:00100000:3.0:1783947521.783241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236117248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.783248:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236117504 00000100:00100000:3.0:1783947521.783285:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236117248:12345-0@lo:400:kworker.0 Request processed in 43us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.783285:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236118016 00000100:00100000:1.0:1783947521.783290:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236118016 00000100:00100000:3.0:1783947521.783295:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1783947521.783306:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236117376 00000100:00100000:1.0:1783947521.783309:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236117376 00000100:00100000:3.0:1783947521.783314:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1783947521.783338:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236117888 00000100:00100000:1.0:1783947521.783342:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236117888 00000100:00100000:2.0:1783947521.783344:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783947521.783346:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236117760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.783361:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236116864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.783369:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783947521.783386:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236117504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947521.783388:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236117760:12345-0@lo:400:kworker.0 Request processed in 47us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947521.783399:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:3.0:1783947521.783424:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947521.783430:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947521.783435:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947521.783435:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236116864:12345-0@lo:400:kworker.0 Request processed in 77us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.783441:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236117504:12345-0@lo:400:kworker.0 Request processed in 56us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947521.783449:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783947521.783453:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783947521.783489:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783947521.783497:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1870604236118016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.783539:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236116864:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.783841:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236116480:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.783933:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236116992:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.783951:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236117504:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.784080:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236116736:0@lo:400:kworker.0 00010000:00080000:2.0:1783947521.784097:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac85edf80 x1870604236117248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947521.784109:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236117248:0@lo:400:kworker.0 00010000:00080000:2.0:1783947521.784125:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac85ec380 x1870604236117760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947521.784134:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236117760:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.784163:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236116608:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.784179:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236117120:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.784194:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236117632:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.786331:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3638:x1870604236118016:12345-0@lo:400:kworker.0 Request processed in 2797us (5289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.786352:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783947521.786398:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783947521.786410:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236118016:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.786416:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236117376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.786491:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236117376:12345-0@lo:400:kworker.0 Request processed in 85us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.786498:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783947521.786705:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783947521.786843:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236117888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.786884:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236117888:12345-0@lo:400:kworker.0 Request processed in 171us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.786891:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783947521.786930:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236117376:0@lo:400:kworker.0 00000100:00100000:1.0:1783947521.786944:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236117888:0@lo:400:kworker.0 00000100:00100000:2.0:1783947521.790352:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236118144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947521.790451:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947521.790581:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236118144 00000100:00100000:1.0:1783947521.790591:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236118144 00000100:00100000:1.0:1783947521.790665:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783947521.790676:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3639:x1870604236118144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947521.790741:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783947521.791526:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3639:x1870604236118144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 845us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947521.791541:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783947521.791772:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236118144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783947522.227726:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947522.292070:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236118272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947522.292174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947522.293416:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236118272 00000100:00100000:3.0:1783947522.293433:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236118272 00000100:00100000:3.0:1783947522.294170:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783947522.294184:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236118272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947522.294225:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783947522.294341:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236118272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947522.294350:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783947522.294701:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236118272:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1783947522.423805:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1783947522.423830:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:0.0:1783947522.492072:0:14652:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947522.492088:0:14652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947522.492129:0:14652:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783947522.492138:0:14652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783947522.616362:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947522.616376:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947522.616409:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783947522.616419:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783947522.616650:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236118400:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947522.616783:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947522.621865:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947522.621912:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214051968 00000100:00100000:3.0:1783947522.621924:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214051968 00000100:00100000:0.0:1783947522.622316:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13793:1870604236118400:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947522.623300:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:3.0:1783947522.623328:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+27:12474:x1870604214051968:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783947522.623376:0:6511:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1783947522.623527:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947522.625759:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+27:12474:x1870604214051968:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 2424us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947522.625778:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 250 00000100:00100000:2.0:1783947522.633321:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947522.633428:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214052224 00000100:00100000:1.0:1783947522.633441:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214052224 00000100:00100000:1.0:1783947522.633547:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 251 00000100:00100000:1.0:1783947522.633571:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+27:12474:x1870604214052224:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947522.633600:0:12193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947522.633630:0:12193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e422f expref: -99 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.633776:0:12193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555011c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.633794:0:12193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555011c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.633808:0:12193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555011c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947522.633822:0:12193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783947522.633964:0:12193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e422f expref: 30 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.633986:0:12193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555011c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e422f expref: 29 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.634025:0:12193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947522.634029:0:12193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947522.634033:0:12193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54200, rc 0) 00000100:00100000:1.0:1783947522.634112:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+29:12474:x1870604214052224:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 556us (818us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1783947522.634121:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 251 00000100:00100000:0.0:1783947522.638101:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947522.638366:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214052352 00000100:00100000:2.0:1783947522.638380:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214052352 00000100:00100000:2.0:1783947522.638500:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:2.0:1783947522.638513:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+29:2407:x1870604214052352:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947522.638535:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947522.638582:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54200/0xe6fd1fdb555011c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e422f expref: 29 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947522.638605:0:7462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947522.638611:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947522.638692:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1eb923ac-790a-478f-897e-124614dbce09+28:2407:x1870604214052352:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 182us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947522.638701:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:0.0:1783947522.646156:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947522.646248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214052608 00000100:00100000:1.0:1783947522.646261:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214052608 00000100:00100000:1.0:1783947522.646350:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 252 00000100:00100000:1.0:1783947522.646362:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+28:12474:x1870604214052608:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783947522.646502:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646526:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646542:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646748:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646757:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646764:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646788:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947522.646807:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646816:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646831:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:1.0:1783947522.646834:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947522.646840:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947522.646847:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54600/0xe6fd1fdb555011d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947522.646999:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+29:12474:x1870604214052608:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 638us (853us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1783947522.647008:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 252 00000040:00080000:0.0:1783947522.647330:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783947522.647337:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783947522.647882:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783947522.647894:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783947522.651803:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947522.652054:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214052864 00000100:00100000:3.0:1783947522.652072:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214052864 00000100:00100000:3.0:1783947522.652161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:3.0:1783947522.652174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+29:12474:x1870604214052864:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947522.652512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+30:12474:x1870604214052864:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 340us (732us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1783947522.652521:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00010000:00010000:1.0:1783947523.251872:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947523.828823:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947523.828859:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236118528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947523.828966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947523.829373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236118528 00000100:00100000:1.0:1783947523.829385:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236118528 00000100:00100000:1.0:1783947523.829529:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1783947523.829542:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236118528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947523.829594:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783947523.829664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236118528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947523.829672:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783947523.831899:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236118528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947524.279044:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947524.475333:0:14703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947524.475344:0:14703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947524.475389:0:14703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783947524.475400:0:14703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783947524.668011:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947524.668600:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214053120 00000100:00100000:3.0:1783947524.668611:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214053120 00000100:00100000:3.0:1783947524.668699:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00100000:3.0:1783947524.668711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+30:12495:x1870604214053120:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947524.668735:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947524.668756:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555011d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4236 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783947524.668977:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783947524.669261:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555011df lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947524.669288:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555011df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947524.669308:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555011df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947524.669321:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783947524.669431:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50c00/0xe6fd1fdb555011d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4236 expref: 33 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947524.669447:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555011df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4236 expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947524.669486:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947524.669490:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783947524.669493:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50000, rc 0) 00000100:00100000:3.0:1783947524.669551:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+32:12495:x1870604214053120:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 843us (1553us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1783947524.669559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 253 00000100:00100000:3.0:1783947524.678640:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947524.678721:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214053248 00000100:00100000:2.0:1783947524.678731:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214053248 00000100:00100000:2.0:1783947524.678861:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 254 00000100:00100000:2.0:1783947524.678873:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+32:12495:x1870604214053248:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:2.0:1783947524.678944:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.678961:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.678974:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.679010:0:8291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.679016:0:8291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.679023:0:8291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.679029:0:8291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947524.679033:0:8291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.679040:0:8291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.679052:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:2.0:1783947524.679055:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947524.679071:0:8291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947524.679079:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b800/0xe6fd1fdb555011ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947524.679726:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1eb923ac-790a-478f-897e-124614dbce09+32:12495:x1870604214053248:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 853us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947524.679736:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 254 00000100:00100000:0.0:1783947524.783689:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947524.784034:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214053376 00000100:00100000:1.0:1783947524.784044:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214053376 00000100:00080000:2.0:1783947524.784129:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947524.784175:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:1.0:1783947524.784188:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+7:2409:x1870604214053376:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:1.0:1783947524.784207:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947524.784230:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab149699/0xe6fd1fdb555011f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e423d expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783947524.784257:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a54e0ff, atime: 0x6a54e0ff, ctime: 0x6a54e0ff, blocks: 0x8 00010000:00010000:1.0:1783947524.784290:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1783947524.784295:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947524.784305:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab149699/0xe6fd1fdb555011f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e423d expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947524.784326:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab149699/0xe6fd1fdb555011f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e423d expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947524.784339:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55c00, rc 0) 00000100:00100000:1.0:1783947524.784414:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+8:2409:x1870604214053376:12345-192.168.204.3@tcp:101:cat.0 Request processed in 230us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947524.784433:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 79 00000100:00100000:1.0:1783947524.791324:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947524.791444:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214053504 00000100:00100000:0.0:1783947524.791492:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214053504 00002000:00100000:0.0:1783947524.791545:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9e7c01d0b100 x1870604214053504/t0(0) o3->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:315/0 lens 488/0 e 0 to 0 dl 1783947535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947524.791555:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7c01d0b100 with x1870604214053504 ext(0->4095) 00002000:00010000:0.0:1783947524.791561:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7c01d0b100 00000100:00100000:0.0:1783947524.791584:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1783947524.791593:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2408:x1870604214053504:12345-192.168.204.3@tcp:3:cat.0 00000100:00100000:0.0:1783947524.791808:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1eb923ac-790a-478f-897e-124614dbce09+8:2408:x1870604214053504:12345-192.168.204.3@tcp:3:cat.0 Request processed in 215us (495us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783947524.791817:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00002000:00100000:0.0:1783947524.791824:0:8432:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9e7c01d0b100 x1870604214053504/t0(0) o3->1eb923ac-790a-478f-897e-124614dbce09@192.168.204.3@tcp:315/0 lens 488/4536 e 0 to 0 dl 1783947535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783947524.791832:0:8432:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9e7c01d0b100 with x1870604214053504 ext(0->4095) 00002000:00010000:0.0:1783947524.791835:0:8432:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e7c01d0b100 00010000:00010000:2.0:1783947525.299954:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947525.364332:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947525.364361:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236118656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947525.364440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947525.364649:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236118656 00000100:00100000:2.0:1783947525.364668:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236118656 00000100:00100000:2.0:1783947525.364748:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783947525.364759:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236118656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783947525.364793:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783947525.365077:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236118656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 320us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947525.365087:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783947525.365189:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236118656:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783947525.365510:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947525.365914:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947525.365927:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236118784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947525.365969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947525.366062:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236118784 00000100:00100000:3.0:1783947525.366068:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236118784 00000100:00100000:3.0:1783947525.366120:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783947525.366128:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236118784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947525.366158:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783947525.366203:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236118784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947525.366210:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783947525.366245:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236118784:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783947525.366422:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947525.607062:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947525.607113:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947525.607145:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947525.607175:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947525.607196:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947525.607216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947525.607259:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947525.607274:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214053632 00000100:00100000:1.0:1783947525.607298:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214053632 00000100:00100000:0.0:1783947525.607317:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214054016 00000100:00100000:0.0:1783947525.607327:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214054016 00000100:00100000:1.0:1783947525.607372:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 388 00000100:00100000:1.0:1783947525.607386:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604214053632:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947525.607394:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214054144 00000100:00100000:0.0:1783947525.607399:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214054144 00000100:00100000:0.0:1783947525.607505:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:0.0:1783947525.607519:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214054016:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947525.607530:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604214053632:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 142us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947525.607541:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 388 00000100:00100000:1.0:1783947525.607594:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214053760 00000100:00100000:0.0:1783947525.607594:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+8:2407:x1870604214054016:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 77us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947525.607603:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214053760 00000100:00100000:0.0:1783947525.607609:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:0.0:1783947525.607633:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:0.0:1783947525.607645:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604214054144:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947525.607666:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214053888 00000100:00100000:1.0:1783947525.607672:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214053888 00000100:00100000:0.0:1783947525.607678:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604214054144:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 34us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947525.607686:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:1.0:1783947525.607711:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214054272 00000100:00100000:1.0:1783947525.607717:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214054272 00000100:00100000:1.0:1783947525.607736:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214054400 00000100:00100000:1.0:1783947525.607739:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214054400 00000100:00100000:1.0:1783947525.607759:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 327 00000100:00100000:1.0:1783947525.607766:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+32:2407:x1870604214053760:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947525.607809:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+32:2407:x1870604214053760:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 43us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947525.607816:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 327 00000100:00100000:1.0:1783947525.607830:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 328 00000100:00100000:1.0:1783947525.607837:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604214053888:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947525.607860:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2406:x1870604214053888:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947525.607877:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 328 00000100:00100000:1.0:1783947525.607890:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 329 00000100:00100000:1.0:1783947525.607896:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214054272:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947525.607924:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214054272:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947525.607930:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 329 00000100:00100000:1.0:1783947525.607941:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 330 00000100:00100000:1.0:1783947525.607947:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604214054400:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947525.607969:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2406:x1870604214054400:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947525.607974:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 330 00000100:00080000:0.0:1783947525.608579:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947525.608588:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947525.608592:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947525.876355:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236118912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947525.876452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947525.876843:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236118912 00000100:00100000:3.0:1783947525.876851:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236118912 00000100:00100000:3.0:1783947525.876903:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783947525.876912:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd2d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236118912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947525.876948:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947525.876997:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd2d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236118912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947525.877004:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783947525.877182:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236118912:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947526.323743:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947526.901865:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947526.901888:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236119040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947526.901964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947526.904075:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119040 00000100:00100000:1.0:1783947526.904086:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119040 00000100:00100000:1.0:1783947526.904148:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783947526.904159:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236119040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947526.904190:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947526.904273:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236119040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947526.904280:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783947526.904329:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236119552:0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.904364:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947526.904377:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236119424:0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.904394:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236120064:0@lo:400:kworker.0 00000100:00100000:0.0:1783947526.904409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947526.904426:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236119936:0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.904431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947526.904443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947526.904487:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236120576:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.904505:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236119168:0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.904509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947526.904538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947526.904564:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236119680:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.904586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947526.904604:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236120192:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.904624:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947526.904661:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1783947526.904667:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1783947526.904694:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7ac7fd1f80, transno 4294967308 00000004:00080000:2.0:1783947526.904704:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1783947526.904717:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7ac8621c00, transno 4294967311 00000100:00100000:2.0:1783947526.904730:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236119040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947526.904753:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236119296:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.904782:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119424 00000100:00100000:2.0:1783947526.904785:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119424 00000100:00100000:2.0:1783947526.904812:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119680 00000100:00100000:2.0:1783947526.904814:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119680 00000100:00100000:2.0:1783947526.904826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1783947526.904831:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236119424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.904864:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236119424:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947526.904870:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1783947526.904881:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783947526.904886:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236119680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.904915:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236119680:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947526.904920:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783947526.904936:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119168 00000100:00100000:2.0:1783947526.904939:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119168 00000100:00100000:2.0:1783947526.904962:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1783947526.904967:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236119168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.904994:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3638:x1870604236119168:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947526.905006:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1783947526.905036:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120064 00000100:00100000:2.0:1783947526.905039:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120064 00000100:00100000:2.0:1783947526.905061:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120576 00000100:00100000:2.0:1783947526.905064:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120576 00000100:00100000:2.0:1783947526.905082:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120192 00000100:00100000:2.0:1783947526.905084:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120192 00000100:00100000:2.0:1783947526.905096:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783947526.905101:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236120064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.905135:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236120064:12345-0@lo:400:kworker.0 Request processed in 34us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947526.905141:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783947526.905152:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783947526.905158:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236120576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.905183:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236120576:12345-0@lo:400:kworker.0 Request processed in 26us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947526.905189:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783947526.905200:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783947526.905206:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236120192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.905247:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1870604236120192:12345-0@lo:400:kworker.0 Request processed in 41us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947526.905254:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783947526.905636:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236120064:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.905647:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236120576:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.905675:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236119168:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.905693:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236119680:0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.905702:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236120192:0@lo:400:kworker.0 00000100:00080000:2.0:1783947526.905752:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947526.906943:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236120448:0@lo:400:kworker.0 00000100:00100000:0.0:1783947526.906996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1783947526.908627:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1783947526.908680:0:6489:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e7ac10b4f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1783947526.908687:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bf7c6aa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e7ac10b46c0 00000020:00080000:2.0:1783947526.908691:0:6489:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9e7bf7c6a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e7bc6516800 00000020:00080000:2.0:1783947526.908722:0:6489:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1783947526.908739:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1783947526.908831:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1783947526.909283:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947526.909297:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947526.909305:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947526.909312:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9aa00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947526.909318:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947526.909327:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947526.909351:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9e7ac761e500) 00010000:00010000:2.0:1783947526.909354:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947526.909380:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947526.909387:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9aa00/0xe6fd1fdb5550116f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947526.912584:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236119424:0@lo:400:kworker.0 00000100:00100000:0.0:1783947526.912633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947526.915043:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119552 00000100:00100000:1.0:1783947526.915508:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119552 00000100:00100000:1.0:1783947526.915619:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119936 00000100:00100000:1.0:1783947526.915624:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119936 00000100:00080000:1.0:1783947526.915653:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947526.915796:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120448 00000100:00100000:1.0:1783947526.915800:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120448 00000100:00100000:1.0:1783947526.915833:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783947526.915842:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236119552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.915936:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236119552:12345-0@lo:400:kworker.0 Request processed in 94us (11571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947526.915943:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783947526.915960:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1783947526.915966:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236119936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.915998:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236119936:12345-0@lo:400:kworker.0 Request processed in 33us (11554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947526.916003:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1783947526.916014:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783947526.916244:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.916277:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236120448:12345-0@lo:400:kworker.0 Request processed in 258us (9281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947526.916283:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:1.0:1783947526.916300:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947526.916335:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236119552:0@lo:400:kworker.0 00010000:00080000:1.0:1783947526.916868:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac84b5c00 x1870604236119936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947526.916896:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236119936:0@lo:400:kworker.0 00010000:00080000:1.0:1783947526.916917:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc9428000 x1870604236120448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947526.916928:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236120448:0@lo:400:kworker.0 00000100:00100000:0.0:1783947526.917725:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236119808:0@lo:400:kworker.0 00000100:00100000:0.0:1783947526.917774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947526.917800:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119296 00000100:00100000:3.0:1783947526.917809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119296 00000100:00100000:2.0:1783947526.917833:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236119808 00000100:00100000:2.0:1783947526.917859:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236119808 00000100:00100000:3.0:1783947526.917862:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1783947526.917880:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236119296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947526.917945:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1783947526.917962:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236119808:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783947526.918157:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947526.920183:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236119296:12345-0@lo:400:kworker.0 Request processed in 2300us (7539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947526.920199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1783947526.922108:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236119808:12345-0@lo:400:kworker.0 Request processed in 4137us (4316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947526.922124:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1783947526.925104:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236119808:0@lo:400:kworker.0 00000100:00100000:0.0:1783947526.925122:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236120320:0@lo:400:kworker.0 00000100:00100000:0.0:1783947526.925186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947526.925250:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236119296:0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.925453:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120320 00000100:00100000:1.0:1783947526.925493:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120320 00000100:00100000:1.0:1783947526.925570:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783947526.925580:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947526.925645:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236120320:12345-0@lo:400:kworker.0 Request processed in 67us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947526.925723:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:2.0:1783947526.925812:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947526.925830:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236120320:0@lo:400:kworker.0 00010000:00010000:1.0:1783947527.352592:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947527.414793:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236120704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947527.414904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947527.415560:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120704 00000100:00100000:1.0:1783947527.415581:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120704 00000100:00100000:1.0:1783947527.415658:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783947527.415669:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236120704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947527.415704:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947527.415782:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236120704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947527.415791:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783947527.416928:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236120704:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1783947527.542312:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1783947527.927859:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1783947527.927879:0:8421:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1783947528.375060:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947528.820682:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783947528.820696:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947528.820723:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783947528.820734:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783947528.948972:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236120832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947528.949062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947528.949403:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120832 00000100:00100000:3.0:1783947528.949412:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120832 00000100:00100000:3.0:1783947528.949592:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1783947528.949603:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236120832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947528.949639:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783947528.949690:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236120832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947528.949697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783947528.949815:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236120832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783947529.395959:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947530.227769:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947530.227891:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214054528 00000100:00100000:1.0:1783947530.227914:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214054528 00000100:00080000:2.0:1783947530.227996:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947530.228004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 255 00000100:00100000:1.0:1783947530.228017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:12148:x1870604214054528:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783947530.228138:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1eb923ac-790a-478f-897e-124614dbce09+18:12148:x1870604214054528:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 124us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947530.228146:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 255 00000100:00100000:0.0:1783947530.236553:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947530.236673:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214054656 00000100:00100000:2.0:1783947530.236684:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214054656 00000100:00100000:2.0:1783947530.236769:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 256 00000100:00100000:2.0:1783947530.236786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:12148:x1870604214054656:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1783947530.236989:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947530.237085:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+5:12148:x1870604214054656:12345-192.168.204.3@tcp:60:lhsmtool_posix.0 Request processed in 308us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947530.237093:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 256 00000100:00100000:0.0:1783947530.239505:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947530.240113:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214054912 00000100:00100000:3.0:1783947530.240125:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214054912 00000100:00100000:3.0:1783947530.240198:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1783947530.240210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+18:12148:x1870604214054912:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783947530.240492:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+19:12148:x1870604214054912:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 284us (996us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1783947530.240502:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00010000:00010000:0.0:1783947530.420063:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947530.485266:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236120960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947530.485337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947530.485562:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236121088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947530.485589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947530.485668:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236120960 00000100:00100000:1.0:1783947530.485677:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236120960 00000100:00100000:1.0:1783947530.485743:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121088 00000100:00100000:1.0:1783947530.485747:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121088 00000100:00100000:1.0:1783947530.485766:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783947530.485775:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236120960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947530.485806:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783947530.485847:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236120960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947530.485854:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783947530.485870:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783947530.485876:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236121088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947530.485885:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783947530.485906:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236121088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947530.485912:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1783947530.486013:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947530.486040:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1783947530.486045:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e7bc9428a80, transno 4294967323 00000004:00080000:3.0:1783947530.486062:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1783947530.486090:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236121088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947530.486120:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236120960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947530.536756:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947530.536923:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055040 00000100:00100000:2.0:1783947530.536933:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055040 00000100:00100000:2.0:1783947530.537009:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 257 00000100:00100000:2.0:1783947530.537020:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:12952:x1870604214055040:12345-192.168.204.3@tcp:101:lsof.0 00010000:00010000:2.0:1783947530.537040:0:8291:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947530.537073:0:8291:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb555011fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4244 expref: -99 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783947530.537077:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783947530.537138:0:8291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55501202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947530.537166:0:8291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55501202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947530.537178:0:8291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55501202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947530.537229:0:8291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947530.537232:0:8291:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947530.537256:0:8291:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55501202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8291 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947530.537279:0:8291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ba00/0xe6fd1fdb555011fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4244 expref: 7 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947530.537295:0:8291:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55501202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4244 expref: 6 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947530.537304:0:8291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:2.0:1783947530.537307:0:8291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947530.537310:0:8291:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a600, rc 0) 00000100:00100000:2.0:1783947530.537380:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:12952:x1870604214055040:12345-192.168.204.3@tcp:101:lsof.0 Request processed in 362us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947530.537388:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 257 00000100:00100000:1.0:1783947530.731252:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947530.731314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947530.731341:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055296 00000100:00100000:2.0:1783947530.731377:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055296 00000100:00100000:1.0:1783947530.731399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947530.731441:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947530.731497:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055168 00000100:00100000:0.0:1783947530.731502:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055168 00000100:00100000:0.0:1783947530.731545:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 390 00000100:00100000:0.0:1783947530.731556:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604214055168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947530.731628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2408:x1870604214055168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947530.731636:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 390 00000100:00080000:0.0:1783947530.731669:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947530.732089:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055424 00000100:00100000:0.0:1783947530.732094:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055424 00000100:00100000:0.0:1783947530.732127:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:0.0:1783947530.732134:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2408:x1870604214055296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947530.732187:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2408:x1870604214055296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 53us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947530.732194:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 146 00000100:00100000:0.0:1783947530.732209:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00100000:0.0:1783947530.732215:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214055424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947530.732238:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+5:2408:x1870604214055424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947530.732244:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 147 00000100:00080000:0.0:1783947530.732257:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947530.738764:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055552 00000100:00100000:3.0:1783947530.738780:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055552 00000100:00100000:3.0:1783947530.738863:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 337 00000100:00100000:3.0:1783947530.738874:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214055552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947530.738972:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2408:x1870604214055552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 99us (7656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947530.738981:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 337 00000100:00080000:0.0:1783947530.741177:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947530.997090:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236121216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947530.997175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947530.997387:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121216 00000100:00100000:3.0:1783947530.997396:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121216 00000100:00100000:3.0:1783947530.997450:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783947530.997489:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236121216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947530.997526:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947530.997580:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236121216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947530.997588:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783947530.997726:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236121216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783947531.443697:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947532.019800:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236121344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947532.019872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.020003:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121344 00000100:00100000:1.0:1783947532.020010:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121344 00000100:00100000:1.0:1783947532.020076:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947532.020087:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236121344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947532.020140:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947532.020191:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236121344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.020198:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783947532.020249:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236121344:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783947532.020533:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947532.020859:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236121600:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.020899:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947532.020937:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236122112:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.020960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947532.020979:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236122624:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.020998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947532.021021:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783947532.021027:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236121728:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.021071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947532.021088:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236122240:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.021108:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947532.021143:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236122752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.021163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.021296:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236121856:0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.021336:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236122368:0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.021388:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236122880:0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.021422:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783947532.021428:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236121472:0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.021503:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236121984:0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.021540:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236122496:0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947532.021608:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121600 00000100:00100000:1.0:1783947532.021615:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121600 00000100:00100000:1.0:1783947532.021648:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236122112 00000100:00100000:1.0:1783947532.021651:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236122112 00000100:00100000:1.0:1783947532.021669:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236122624 00000100:00100000:1.0:1783947532.021672:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236122624 00000100:00100000:1.0:1783947532.021691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236122240 00000100:00100000:1.0:1783947532.021693:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236122240 00000100:00100000:1.0:1783947532.021706:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236122752 00000100:00100000:1.0:1783947532.021708:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236122752 00000100:00100000:1.0:1783947532.021723:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121856 00000100:00100000:1.0:1783947532.021725:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121856 00000100:00100000:3.0:1783947532.021740:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121728 00000100:00100000:1.0:1783947532.021742:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1783947532.021749:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121728 00000100:00100000:1.0:1783947532.021754:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236121600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947532.021788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121984 00000100:00100000:3.0:1783947532.021792:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121984 00000100:00100000:1.0:1783947532.021811:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236121600:12345-0@lo:400:kworker.0 Request processed in 59us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.021820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1783947532.021836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1783947532.021842:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236122112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021869:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1870604236122112:12345-0@lo:400:kworker.0 Request processed in 27us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.021875:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1783947532.021886:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1783947532.021891:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236122624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021915:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236122624:12345-0@lo:400:kworker.0 Request processed in 24us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.021922:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1783947532.021931:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783947532.021936:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236122240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.021969:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236122240:12345-0@lo:400:kworker.0 Request processed in 33us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.021976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783947532.021989:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783947532.021996:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236122752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947532.022006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783947532.022018:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236121728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.022027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236122752:12345-0@lo:400:kworker.0 Request processed in 30us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947532.022033:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783947532.022048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1783947532.022057:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236121856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947532.022067:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236121728:12345-0@lo:400:kworker.0 Request processed in 52us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947532.022074:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783947532.022090:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783947532.022099:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236121856:12345-0@lo:400:kworker.0 Request processed in 42us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947532.022100:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236121984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.022135:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1783947532.022155:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236121984:12345-0@lo:400:kworker.0 Request processed in 57us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947532.022169:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783947532.022177:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236121984:0@lo:400:kworker.0 00000100:00100000:1.0:1783947532.022192:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236121856:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022416:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236122368 00000100:00100000:0.0:1783947532.022421:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236122368 00000100:00100000:0.0:1783947532.022486:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236122880 00000100:00100000:0.0:1783947532.022490:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236122880 00000100:00100000:0.0:1783947532.022508:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236122496 00000100:00100000:0.0:1783947532.022511:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236122496 00000100:00100000:0.0:1783947532.022525:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783947532.022531:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236122368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022572:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236122368:12345-0@lo:400:kworker.0 Request processed in 41us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947532.022578:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783947532.022590:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783947532.022595:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236122880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022623:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236122880:12345-0@lo:400:kworker.0 Request processed in 29us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947532.022628:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783947532.022638:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783947532.022643:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236122496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022667:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236122496:12345-0@lo:400:kworker.0 Request processed in 25us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947532.022672:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1783947532.022699:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783947532.022703:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947532.022706:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947532.022708:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947532.022731:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236121728:0@lo:400:kworker.0 00010000:00080000:0.0:1783947532.022745:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac84b5c00 x1870604236122240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947532.022755:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236122240:0@lo:400:kworker.0 00010000:00080000:0.0:1783947532.022766:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac84b5180 x1870604236122752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947532.022775:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236122752:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022785:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236121600:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022798:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1870604236122112:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022807:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236122624:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022838:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236122496:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022847:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236122368:0@lo:400:kworker.0 00000100:00100000:0.0:1783947532.022856:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236122880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947532.023147:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236121472 00000100:00100000:2.0:1783947532.023153:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236121472 00000100:00100000:2.0:1783947532.023193:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1783947532.023201:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236121472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947532.023244:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236121472:12345-0@lo:400:kworker.0 Request processed in 45us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947532.023250:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1783947532.023447:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236121472:0@lo:400:kworker.0 00010000:00010000:0.0:1783947532.467818:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947532.534175:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947532.534201:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236123008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947532.534281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947532.534442:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123008 00000100:00100000:0.0:1783947532.534452:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123008 00000100:00100000:0.0:1783947532.534545:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783947532.534554:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236123008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947532.534580:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947532.534659:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236123008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947532.534667:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783947532.535427:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236123008:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1783947532.536111:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1783947532.536133:0:6489:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1783947532.536201:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783947532.536214:0:6542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1783947533.491772:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947534.067849:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236123136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947534.067920:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947534.068329:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123136 00000100:00100000:1.0:1783947534.068338:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123136 00000100:00100000:1.0:1783947534.068392:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783947534.068403:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236123136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947534.068438:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783947534.068506:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236123136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947534.068514:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783947534.068564:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236123136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947534.515708:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947534.671411:0:14901:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:58:52 (1783947532) 00010000:00010000:1.0:1783947535.540132:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947535.604325:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236123264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947535.604397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947535.604488:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123264 00000100:00100000:3.0:1783947535.604497:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123264 00000100:00100000:3.0:1783947535.604562:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783947535.604573:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236123264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947535.604613:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783947535.604658:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236123264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947535.604665:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1783947535.604686:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947535.604722:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236123264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947535.605239:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236123392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947535.605336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947535.605433:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123392 00000100:00100000:3.0:1783947535.605438:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123392 00000100:00100000:3.0:1783947535.605660:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783947535.605668:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236123392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947535.605685:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783947535.605722:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236123392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947535.605729:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783947535.605923:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236123392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783947535.605966:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947535.847438:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947535.847531:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947535.847559:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947535.847587:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947535.847612:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947535.847663:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214056192 00000100:00100000:3.0:1783947535.847700:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214056192 00000100:00100000:3.0:1783947535.848010:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:3.0:1783947535.848030:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214056192:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947535.848148:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214056192:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 122us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947535.848157:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 151 00000100:00100000:0.0:1783947535.848251:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055680 00000100:00100000:0.0:1783947535.848273:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055680 00000100:00100000:0.0:1783947535.848347:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 392 00000100:00100000:0.0:1783947535.848360:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604214055680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947535.848428:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2407:x1870604214055680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 71us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947535.848437:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 392 00000100:00100000:2.0:1783947535.848793:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055936 00000100:00100000:2.0:1783947535.848799:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055936 00000100:00100000:2.0:1783947535.848846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214056448 00000100:00100000:2.0:1783947535.848850:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214056448 00000100:00100000:3.0:1783947535.848880:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 344 00000100:00100000:3.0:1783947535.848896:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214055936:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947535.848973:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1eb923ac-790a-478f-897e-124614dbce09+5:2407:x1870604214055936:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 82us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947535.849326:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947535.849355:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947535.849374:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214055808 00000100:00100000:1.0:1783947535.849378:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214055808 00000100:00100000:0.0:1783947535.849482:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214056320 00000100:00100000:0.0:1783947535.849490:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214056320 00000100:00100000:2.0:1783947535.854335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 345 00000100:00100000:2.0:1783947535.854398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214056448:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947535.854444:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 344 00000100:00100000:2.0:1783947535.854523:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214056448:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 137us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947535.854536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 345 00000100:00100000:1.0:1783947535.855278:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 346 00000100:00100000:1.0:1783947535.855297:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:2407:x1870604214055808:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947535.855351:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 347 00000100:00100000:0.0:1783947535.855372:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214056320:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947535.855483:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214056320:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 94us (6099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947535.855501:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 347 00000100:00100000:1.0:1783947535.855507:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+18:2407:x1870604214055808:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 205us (7880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947535.855521:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 346 00000100:00080000:1.0:1783947535.855554:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947535.855559:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947535.855562:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947535.855574:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214056064 00000100:00100000:1.0:1783947535.855582:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214056064 00000100:00100000:1.0:1783947535.855627:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00100000:1.0:1783947535.855633:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214056064:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947535.855666:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1eb923ac-790a-478f-897e-124614dbce09+7:2407:x1870604214056064:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 33us (6344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947535.855673:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 152 00000100:00080000:1.0:1783947535.855695:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947536.117751:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236123520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947536.117858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947536.122966:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123520 00000100:00100000:2.0:1783947536.122989:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123520 00000100:00100000:2.0:1783947536.123098:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1783947536.123113:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236123520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947536.123170:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783947536.123306:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236123520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (5435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947536.123315:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1783947536.123397:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236123520:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783947536.563655:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947537.143836:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947537.143870:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236123648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947537.143969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947537.144326:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123648 00000100:00100000:1.0:1783947537.144337:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123648 00000100:00100000:1.0:1783947537.144433:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783947537.144448:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236123648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947537.144515:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947537.144600:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236123648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947537.144607:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783947537.144672:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236123648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947537.145177:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236123904:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.145233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947537.145269:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236124416:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.145293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947537.145317:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236124928:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.145362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947537.145385:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783947537.145391:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236124032:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.145421:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947537.145631:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236124160:0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.145666:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947537.145688:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236124672:0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.145727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947537.145746:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236125184:0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.145767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947537.145786:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783947537.145792:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236123776:0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.145823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947537.145848:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236124288:0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.145883:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124672 00000100:00100000:3.0:1783947537.145898:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124672 00000100:00100000:3.0:1783947537.145946:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125184 00000100:00100000:3.0:1783947537.145949:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125184 00000100:00100000:3.0:1783947537.145974:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783947537.145982:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236124672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.146052:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236124672:12345-0@lo:400:kworker.0 Request processed in 70us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.146059:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783947537.146074:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783947537.146080:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236125184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.146108:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236125184:12345-0@lo:400:kworker.0 Request processed in 28us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.146113:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783947537.146164:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123904 00000100:00100000:3.0:1783947537.146167:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123904 00000100:00100000:3.0:1783947537.146194:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124416 00000100:00100000:3.0:1783947537.146197:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124416 00000100:00100000:3.0:1783947537.146209:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124928 00000100:00100000:3.0:1783947537.146212:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124928 00000100:00100000:3.0:1783947537.146238:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124160 00000100:00100000:3.0:1783947537.146241:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124160 00000100:00100000:3.0:1783947537.146254:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783947537.146259:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236123904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.146291:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236123904:12345-0@lo:400:kworker.0 Request processed in 30us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.146297:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1783947537.146309:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1783947537.146315:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236124416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.146355:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236124416:12345-0@lo:400:kworker.0 Request processed in 40us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.146361:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1783947537.146373:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1783947537.146379:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.146406:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236124928:12345-0@lo:400:kworker.0 Request processed in 28us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.146411:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1783947537.146423:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1783947537.146442:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236124160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.146518:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236124160:12345-0@lo:400:kworker.0 Request processed in 76us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.146525:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1783947537.146574:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236123776 00000100:00100000:3.0:1783947537.146579:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236123776 00000100:00100000:3.0:1783947537.146609:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1783947537.146615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236123776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947537.146650:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236123776:12345-0@lo:400:kworker.0 Request processed in 35us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.146656:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1783947537.147129:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236124544:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.147161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947537.147179:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236125056:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.147201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947537.147250:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236123904:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.147265:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236124416:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.147278:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236124928:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.147326:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124544 00000100:00100000:0.0:1783947537.147332:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124544 00000100:00100000:0.0:1783947537.147368:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125056 00000100:00100000:0.0:1783947537.147371:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125056 00000100:00100000:0.0:1783947537.147388:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783947537.147395:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236124544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.147678:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236124544:12345-0@lo:400:kworker.0 Request processed in 282us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947537.147686:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783947537.147703:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00080000:2.0:1783947537.147825:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947537.147831:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947537.147835:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783947537.147838:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783947537.147886:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947537.147920:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236124800:0@lo:400:kworker.0 00000100:00100000:2.0:1783947537.147956:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947537.147990:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236124160:0@lo:400:kworker.0 00000100:00100000:2.0:1783947537.148004:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236124672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947537.148047:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236125184:0@lo:400:kworker.0 00000100:00100000:2.0:1783947537.148071:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236123776:0@lo:400:kworker.0 00000100:00100000:2.0:1783947537.148096:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124032 00000100:00100000:2.0:1783947537.148100:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124032 00000100:00100000:2.0:1783947537.148137:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124288 00000100:00100000:2.0:1783947537.148140:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124288 00000100:00100000:2.0:1783947537.148153:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1783947537.148159:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236124032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947537.148201:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236124032:12345-0@lo:400:kworker.0 Request processed in 42us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947537.148207:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1783947537.148234:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783947537.148241:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236124288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947537.148278:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236124288:12345-0@lo:400:kworker.0 Request processed in 38us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947537.148283:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783947537.148315:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236124288:0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.148694:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236125056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947537.148805:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236125056:12345-0@lo:400:kworker.0 Request processed in 117us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947537.148825:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1783947537.148869:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236124032:0@lo:400:kworker.0 00010000:00080000:0.0:1783947537.148887:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e3480 x1870604236124544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947537.148898:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236124544:0@lo:400:kworker.0 00010000:00080000:0.0:1783947537.148908:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0700 x1870604236125056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947537.148917:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236125056:0@lo:400:kworker.0 00000100:00100000:1.0:1783947537.149145:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236124800 00000100:00100000:1.0:1783947537.149152:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236124800 00000100:00100000:1.0:1783947537.149206:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783947537.149215:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236124800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947537.149288:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236124800:12345-0@lo:400:kworker.0 Request processed in 75us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947537.149295:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1783947537.149419:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947537.149573:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236124800:0@lo:400:kworker.0 00010000:00010000:2.0:1783947537.587699:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947537.651901:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947537.651937:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236125312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947537.652056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947537.652503:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125312 00000100:00100000:3.0:1783947537.652516:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125312 00000100:00100000:3.0:1783947537.652600:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783947537.652615:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236125312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947537.652654:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783947537.652743:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236125312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947537.652752:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783947537.652888:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236125312:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1783947537.780414:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783947538.039436:0:13793:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783947538.039450:0:13793:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783947538.039613:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1783947538.039640:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783947538.612515:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947538.715763:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947538.716936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214056704 00000100:00100000:3.0:1783947538.717282:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214056704 00000100:00100000:3.0:1783947538.717511:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:3.0:1783947538.717528:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+18:13175:x1870604214056704:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:3.0:1783947538.718830:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1eb923ac-790a-478f-897e-124614dbce09+19:13175:x1870604214056704:12345-192.168.204.3@tcp:35:umount.0 Request processed in 1292us (3065us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1783947538.718845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00080000:2.0:1783947538.721436:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947538.727754:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947538.727872:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214056960 00000100:00100000:1.0:1783947538.727885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214056960 00000100:00100000:1.0:1783947538.727972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:1.0:1783947538.727985:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+19:13175:x1870604214056960:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:1.0:1783947538.728402:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1eb923ac-790a-478f-897e-124614dbce09+20:13175:x1870604214056960:12345-192.168.204.3@tcp:35:umount.0 Request processed in 418us (661us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1783947538.728411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:1.0:1783947538.731586:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947538.735370:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214057216 00000100:00100000:0.0:1783947538.735393:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214057216 00000100:00100000:0.0:1783947538.735580:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:0.0:1783947538.735596:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf681c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+20:13175:x1870604214057216:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:0.0:1783947538.735946:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf681c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+21:13175:x1870604214057216:12345-192.168.204.3@tcp:35:umount.0 Request processed in 352us (4375us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783947538.737371:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:3.0:1783947538.742345:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947538.745420:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214057472 00000100:00100000:0.0:1783947538.745445:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214057472 00000100:00100000:0.0:1783947538.745571:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:0.0:1783947538.745848:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+21:13175:x1870604214057472:12345-192.168.204.3@tcp:35:umount.0 00000100:00100000:0.0:1783947538.746933:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1eb923ac-790a-478f-897e-124614dbce09+22:13175:x1870604214057472:12345-192.168.204.3@tcp:35:umount.0 Request processed in 1310us (4594us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1783947538.746945:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:2.0:1783947538.756282:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947538.756328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947538.756436:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947538.756597:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214057728 00000100:00100000:1.0:1783947538.756610:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214057728 00000100:00100000:1.0:1783947538.756705:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214057600 00000100:00100000:1.0:1783947538.756709:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214057600 00000100:00100000:0.0:1783947538.756717:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214057856 00000100:00100000:0.0:1783947538.756724:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214057856 00000100:00100000:1.0:1783947538.756741:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1783947538.756755:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+15:2409:x1870604214057728:12345-192.168.204.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783947538.756763:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:0.0:1783947538.756774:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45d06cee-8339-4f75-880b-33b7e0c9e5a1+15:2406:x1870604214057600:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947538.756780:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947538.756785:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947538.756811:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439c00/0xe6fd1fdb5550011c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d58 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947538.756834:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947538.756898:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+14:2409:x1870604214057728:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 147us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947538.756906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:1.0:1783947538.756927:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1783947538.756934:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+13:2406:x1870604214057856:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947538.756942:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947538.756966:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e51000/0xe6fd1fdb555003f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e70 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947538.756978:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947538.757005:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+12:2406:x1870604214057856:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 62us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947538.757013:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00010000:00010000:0.0:1783947538.757307:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438200/0xe6fd1fdb555001d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d97 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947538.757363:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947538.757508:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214057984 00000100:00100000:3.0:1783947538.757513:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214057984 00000100:00100000:3.0:1783947538.757566:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00080000:2.0:1783947538.757646:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783947538.757710:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947538.757764:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2406:x1870604214057600:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 991us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947538.757774:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:3.0:1783947538.757798:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+5:2405:x1870604214057984:12345-192.168.204.3@tcp:9:umount.0 00000020:00000080:3.0:1783947538.757833:0:8539:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555004f7 00000100:00080000:3.0:1783947538.757844:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7cc3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947538.757904:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1783947538.758087:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1eb923ac-790a-478f-897e-124614dbce09+2:2405:x1870604214057984:12345-192.168.204.3@tcp:9:umount.0 Request processed in 293us (723us total) trans 0 rc 0/0 00010000:00010000:0.0:1783947538.758095:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947538.764833:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 80 00000100:00100000:3.0:1783947538.774127:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947538.775338:0:10351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214058368 00000100:00100000:0.0:1783947538.775354:0:10351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214058368 00000100:00080000:2.0:1783947538.775681:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947538.776735:0:10351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 81 00000100:00100000:0.0:1783947538.776759:0:10351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+7:2405:x1870604214058368:12345-192.168.204.3@tcp:9:umount.0 00000020:00000080:0.0:1783947538.776806:0:10351:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550076d 00000020:00010000:0.0:1783947538.776818:0:10351:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7c01d49800: total 0 00000100:00080000:0.0:1783947538.776824:0:10351:0:(import.c:65:import_set_state_nolock()) ffff9e7c01d4c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783947538.776895:0:10351:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783947538.777159:0:10351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2405:x1870604214058368:12345-192.168.204.3@tcp:9:umount.0 Request processed in 410us (3047us total) trans 0 rc 0/0 00010000:00010000:2.0:1783947538.777565:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947538.779003:0:10351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 81 00000020:00010000:2.0:1783947538.779450:0:10390:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7c01d49800: total 0 00010000:00010000:2.0:1783947538.779565:0:10390:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7c01d49800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1783947538.779659:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079ce7076/0xe6fd1fdb55500b25 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e405a expref: 4 pid: 10351 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947538.779702:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab149699/0xe6fd1fdb555011f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e423d expref: 3 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947538.779718:0:10390:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7c01d49800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1783947538.779732:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947538.779734:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947538.779736:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947538.789942:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947538.790754:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214059392 00000100:00100000:2.0:1783947538.790769:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214059392 00000100:00100000:2.0:1783947538.790913:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 258 00000100:00100000:2.0:1783947538.790926:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+22:2405:x1870604214059392:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:2.0:1783947538.790976:0:6510:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550012a 00000020:00010000:2.0:1783947538.791009:0:6510:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7ac588f800: total 0 00000100:00080000:2.0:1783947538.791015:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9e7ac588a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783947538.791055:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1783947538.791557:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1eb923ac-790a-478f-897e-124614dbce09+21:2405:x1870604214059392:12345-192.168.204.3@tcp:39:umount.0 Request processed in 631us (1626us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1783947538.791586:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 258 00000020:00010000:3.0:1783947538.791678:0:6498:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7ac588f800: total 0 00010000:00010000:3.0:1783947538.791744:0:6498:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7ac588f800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783947538.791790:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947538.791794:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947538.791812:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55200/0xe6fd1fdb55500e97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4156 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.791840:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:3.0:1783947538.791843:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947538.791847:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f000/0xe6fd1fdb55500b8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4076 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.791862:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947538.791865:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783947538.791868:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e50000/0xe6fd1fdb555011df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4236 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.791883:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947538.791885:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783947538.791889:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9be00/0xe6fd1fdb555004cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e9a expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.791904:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947538.791906:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783947538.791910:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9ac00/0xe6fd1fdb55500b10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4053 expref: 16 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.791924:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7bd001b800) 00010000:00010000:3.0:1783947538.791926:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783947538.791929:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55500472 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e85 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.791947:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947538.791955:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947538.791959:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54a00/0xe6fd1fdb55500ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4045 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.791975:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9e7bc5593c00) 00010000:00010000:3.0:1783947538.791978:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783947538.791981:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55a00/0xe6fd1fdb555007c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3f73 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.792007:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947538.792009:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947538.792013:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7e51800/0xe6fd1fdb555010d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e41f0 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.792028:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9e7bc8a89100) 00010000:00010000:3.0:1783947538.792031:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783947538.792035:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f400/0xe6fd1fdb55500baa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e407d expref: 11 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.792051:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9e7ac761e200) 00010000:00010000:3.0:1783947538.792054:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947538.792058:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54000/0xe6fd1fdb555011b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4228 expref: 10 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.792074:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9e7bc5593100) 00010000:00010000:3.0:1783947538.792076:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783947538.792080:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ee00/0xe6fd1fdb55500a06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e400d expref: 9 pid: 12193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.792112:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7bfcba0500) 00010000:00010000:3.0:1783947538.792115:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947538.792119:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55500456 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e7e expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947538.792133:0:6498:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7ac588f800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1783947538.792148:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947538.792150:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947538.792153:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947538.792934:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947538.805031:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947538.805312:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214059520 00000100:00100000:2.0:1783947538.805326:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214059520 00000100:00100000:2.0:1783947538.805544:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 259 00000100:00100000:2.0:1783947538.805559:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+5:2405:x1870604214059520:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:2.0:1783947538.805624:0:12193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500131 00000100:00080000:2.0:1783947538.805649:0:12193:0:(import.c:65:import_set_state_nolock()) ffff9e7ac65c5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783947538.805683:0:12193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783947538.805905:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1eb923ac-790a-478f-897e-124614dbce09+3:2405:x1870604214059520:12345-192.168.204.3@tcp:39:umount.0 Request processed in 350us (890us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783947538.805914:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 259 00010000:00010000:1.0:1783947538.806409:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947538.810367:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947539.188636:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947539.188674:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236125440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947539.188786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947539.189970:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125440 00000100:00100000:3.0:1783947539.189998:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125440 00000100:00100000:3.0:1783947539.190084:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1783947539.190098:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236125440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947539.190163:0:9303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783947539.190268:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236125440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947539.190276:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1783947539.190443:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236125440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783947539.635619:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947540.660365:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947540.725225:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236125568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947540.725348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947540.725695:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125568 00000100:00100000:1.0:1783947540.725705:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125568 00000100:00100000:1.0:1783947540.725795:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783947540.725812:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236125568:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947540.725818:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947540.725859:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236125696:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947540.725884:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783947540.725948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947540.726000:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236125568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 192us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947540.726011:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1783947540.726023:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947540.726039:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125696 00000100:00100000:1.0:1783947540.726047:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125696 00000100:00100000:1.0:1783947540.726085:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783947540.726094:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236125696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947540.726109:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783947540.726158:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236125696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947540.726164:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783947540.726271:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236125696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783947540.726334:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947540.726502:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236125568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947540.967580:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947540.967624:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947540.967671:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947540.967876:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214059776 00000100:00100000:3.0:1783947540.967888:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214059776 00000100:00100000:3.0:1783947540.967970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214059904 00000100:00100000:3.0:1783947540.967973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214059904 00000100:00100000:3.0:1783947540.967995:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 354 00000100:00100000:3.0:1783947540.968004:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214059776:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947540.968112:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2407:x1870604214059776:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 109us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947540.968120:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 354 00000100:00100000:3.0:1783947540.968137:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 355 00000100:00100000:3.0:1783947540.968144:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214059904:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947540.968166:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2407:x1870604214059904:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947540.968171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 355 00000100:00100000:2.0:1783947540.968703:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214059648 00000100:00100000:2.0:1783947540.968709:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214059648 00000100:00100000:2.0:1783947540.968749:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 394 00000100:00100000:2.0:1783947540.968755:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604214059648:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947540.968798:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604214059648:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 44us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947540.968805:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 394 00000100:00080000:1.0:1783947540.969490:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947540.969496:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783947541.237269:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236125824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947541.237343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947541.237517:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125824 00000100:00100000:3.0:1783947541.237526:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125824 00000100:00100000:3.0:1783947541.237581:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1783947541.237591:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236125824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947541.237629:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783947541.237692:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236125824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947541.237699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783947541.237992:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac842b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236125824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947541.322397:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947541.322716:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947541.329899:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947541.331669:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214060032 00000100:00100000:0.0:1783947541.331689:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214060032 00000100:00100000:0.0:1783947541.332434:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214060288 00000100:00100000:0.0:1783947541.332442:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214060288 00000100:00100000:3.0:1783947541.333232:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:3.0:1783947541.333253:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+11:2407:x1870604214060032:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947541.334429:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947541.334503:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439a00/0xe6fd1fdb5550022d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3dac expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947541.334541:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947541.334652:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+10:2407:x1870604214060032:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1405us (13433us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947541.334687:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:3.0:1783947541.334791:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1783947541.334803:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+9:2407:x1870604214060288:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947541.334820:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947541.334833:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb555003ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3e69 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947541.334843:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947541.334866:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:2407:x1870604214060288:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 66us (12150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947541.334873:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:0.0:1783947541.341322:0:7462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214060160 00000100:00100000:0.0:1783947541.341346:0:7462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214060160 00000100:00100000:0.0:1783947541.341493:0:7462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:0.0:1783947541.341506:0:7462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45d06cee-8339-4f75-880b-33b7e0c9e5a1+8:2407:x1870604214060160:12345-192.168.204.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1783947541.341938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947541.342064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214060544 00000100:00100000:3.0:1783947541.342070:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214060544 00000100:00100000:3.0:1783947541.342168:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 260 00000100:00100000:3.0:1783947541.342177:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+6:2405:x1870604214060544:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:3.0:1783947541.342251:0:6511:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500242 00000020:00010000:3.0:1783947541.342271:0:6511:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7ac7c07800: total 0 00000100:00080000:3.0:1783947541.342277:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9e7ac7c01000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947541.342317:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:2.0:1783947541.342395:0:6499:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7ac7c07800: total 0 00010000:00010000:2.0:1783947541.342494:0:6499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7ac7c07800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783947541.342543:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bc4b3ce00) 00010000:00010000:2.0:1783947541.342546:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947541.342556:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a600/0xe6fd1fdb55501202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4244 expref: 5 pid: 8291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947541.342584:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b25d4884-3548-4434-8d96-3aed90ce07dc+4:2405:x1870604214060544:12345-192.168.204.3@tcp:39:umount.0 Request processed in 408us (647us total) trans 4294967528 rc 0/0 00010000:00010000:2.0:1783947541.342587:0:6499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7ac7c07800, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1783947541.342592:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 260 00010000:00010000:2.0:1783947541.342600:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947541.342602:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947541.342604:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947541.342672:0:7462:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947541.342691:0:7462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5ea00/0xe6fd1fdb55500234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3ddd expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947541.342708:0:7462:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947541.342734:0:7462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45d06cee-8339-4f75-880b-33b7e0c9e5a1+7:2407:x1870604214060160:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 1231us (12856us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947541.342768:0:7462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947541.355870:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947541.356009:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214060672 00000100:00100000:0.0:1783947541.356023:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214060672 00000100:00100000:0.0:1783947541.356224:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 261 00000100:00100000:0.0:1783947541.356239:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+5:2405:x1870604214060672:12345-192.168.204.3@tcp:39:umount.0 00000020:00000080:0.0:1783947541.356295:0:8291:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500249 00000100:00080000:0.0:1783947541.356308:0:8291:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77cd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783947541.356345:0:8291:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1783947541.356610:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b25d4884-3548-4434-8d96-3aed90ce07dc+3:2405:x1870604214060672:12345-192.168.204.3@tcp:39:umount.0 Request processed in 374us (757us total) trans 4294967300 rc 0/0 00010000:00010000:1.0:1783947541.358391:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947541.363706:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 261 00000100:00100000:2.0:1783947541.408912:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947541.409149:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214060928 00000100:00100000:3.0:1783947541.409162:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214060928 00000100:00100000:3.0:1783947541.409246:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 395 00000100:00100000:3.0:1783947541.409389:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+7:2405:x1870604214060928:12345-192.168.204.3@tcp:251:umount.0 00000020:00000080:3.0:1783947541.409453:0:6503:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500107 00000020:00010000:3.0:1783947541.409521:0:6503:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7ac5889800: total 0 00000100:00080000:3.0:1783947541.409527:0:6503:0:(import.c:65:import_set_state_nolock()) ffff9e7ac588c800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783947541.409630:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:45d06cee-8339-4f75-880b-33b7e0c9e5a1+3:2405:x1870604214060928:12345-192.168.204.3@tcp:251:umount.0 Request processed in 245us (734us total) trans 0 rc 0/0 00010000:00010000:0.0:1783947541.409690:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947541.417801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 395 00000020:00010000:0.0:1783947541.424476:0:6498:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7ac5889800: total 0 00010000:00010000:0.0:1783947541.424500:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947541.424606:0:6498:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7ac5889800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783947541.424675:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6439600/0xe6fd1fdb555001e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e3d9e expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947541.424700:0:6498:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7ac5889800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783947541.424711:0:6498:0:(genops.c:906:class_export_put()) final put ffff9e7ac5889800/45d06cee-8339-4f75-880b-33b7e0c9e5a1 00010000:00010000:0.0:1783947541.424737:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947541.424740:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947541.424742:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947541.426222:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5889800/45d06cee-8339-4f75-880b-33b7e0c9e5a1 for MGS 00000020:00000080:2.0:1783947541.426319:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac588c800 for MGS 00010000:00010000:2.0:1783947541.684171:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947542.259903:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236125952:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947542.260075:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236126464:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260105:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947542.260126:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236126976:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947542.260165:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc4744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236127488:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947542.260211:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783947542.260217:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236126080:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947542.260260:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236126592:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947542.260294:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236127104:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947542.260344:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236125952 00000100:00100000:3.0:1783947542.260352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236125952 00000100:00100000:3.0:1783947542.260402:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1783947542.260418:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236125952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260492:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236125952:12345-0@lo:400:kworker.0 Request processed in 75us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.260500:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1783947542.260534:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126464 00000100:00100000:3.0:1783947542.260538:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126464 00000100:00100000:3.0:1783947542.260577:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783947542.260584:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236126464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236126464:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.260623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1783947542.260641:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126976 00000100:00100000:3.0:1783947542.260644:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126976 00000100:00100000:3.0:1783947542.260674:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236127488 00000100:00100000:3.0:1783947542.260677:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236127488 00000100:00100000:3.0:1783947542.260695:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947542.260701:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236126976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260735:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236126976:12345-0@lo:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.260741:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947542.260752:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783947542.260757:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236127488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260795:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236127488:12345-0@lo:400:kworker.0 Request processed in 37us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.260800:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783947542.260821:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126080 00000100:00100000:3.0:1783947542.260824:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126080 00000100:00100000:3.0:1783947542.260857:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1783947542.260862:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236126080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260894:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236126080:12345-0@lo:400:kworker.0 Request processed in 32us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.260899:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1783947542.260910:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126592 00000100:00100000:3.0:1783947542.260913:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126592 00000100:00100000:3.0:1783947542.260945:0:12193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236127104 00000100:00100000:3.0:1783947542.260948:0:12193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236127104 00000100:00100000:3.0:1783947542.260962:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1783947542.260968:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236126592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.260994:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac842ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236126592:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.260999:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1783947542.261009:0:12193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783947542.261014:0:12193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236127104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.261040:0:12193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236127104:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947542.261045:0:12193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783947542.261097:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236126080:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.261108:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236126592:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.261117:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236127104:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.261126:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236125952:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.261136:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236126464:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.261159:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236126976:0@lo:400:kworker.0 00000100:00100000:3.0:1783947542.261168:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc4744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236127488:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.261491:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236126336:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.261529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947542.261622:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236126848:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.261658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947542.261678:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236127360:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.261698:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947542.261718:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783947542.261725:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236126208:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.261747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947542.261832:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236126720:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.261855:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947542.261873:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236127232:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.261891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947542.262052:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126336 00000100:00100000:1.0:1783947542.262058:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126336 00000100:00100000:1.0:1783947542.262087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126720 00000100:00100000:1.0:1783947542.262089:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126720 00000100:00100000:1.0:1783947542.262104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236127232 00000100:00100000:1.0:1783947542.262107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236127232 00000100:00100000:1.0:1783947542.262132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1783947542.262140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236126336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947542.262184:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236126336:12345-0@lo:400:kworker.0 Request processed in 46us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.262190:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1783947542.262205:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1783947542.262211:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236126720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947542.262237:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236126720:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.262243:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1783947542.262253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1783947542.262258:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236127232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947542.262283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236127232:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.262288:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:1.0:1783947542.262303:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783947542.262307:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947542.262311:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947542.262313:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947542.262323:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126848 00000100:00100000:1.0:1783947542.262327:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126848 00000100:00100000:1.0:1783947542.262353:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236127360 00000100:00100000:1.0:1783947542.262356:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236127360 00000100:00100000:1.0:1783947542.262374:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783947542.262379:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236126848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947542.262409:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236126848:12345-0@lo:400:kworker.0 Request processed in 30us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.262423:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783947542.262434:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783947542.262439:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236127360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947542.262481:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236127360:12345-0@lo:400:kworker.0 Request processed in 42us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.262487:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783947542.262539:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236127616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783947542.262652:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236126208 00000100:00100000:0.0:1783947542.262657:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236126208 00000100:00100000:0.0:1783947542.262685:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783947542.262691:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236126208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.262725:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236126208:12345-0@lo:400:kworker.0 Request processed in 34us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947542.262731:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783947542.262860:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947542.262892:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236127616 00000100:00100000:1.0:1783947542.262896:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236127616 00000100:00100000:0.0:1783947542.263157:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236126208:0@lo:400:kworker.0 00010000:00080000:0.0:1783947542.263172:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c93800 x1870604236126720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947542.263182:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236126720:0@lo:400:kworker.0 00010000:00080000:0.0:1783947542.263192:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7c93480 x1870604236127232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947542.263201:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236127232:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.263219:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236126336:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.263229:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236126848:0@lo:400:kworker.0 00000100:00100000:0.0:1783947542.263238:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236127360:0@lo:400:kworker.0 00000100:00100000:1.0:1783947542.263314:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783947542.263323:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236127616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947542.263347:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783947542.263386:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236127616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947542.263393:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1783947542.263418:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947542.263422:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947542.263443:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236127616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783947542.707899:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947542.771799:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947542.771826:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236127744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947542.771902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947542.771993:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236127744 00000100:00100000:2.0:1783947542.772004:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236127744 00000100:00100000:2.0:1783947542.772073:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783947542.772083:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236127744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783947542.772108:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783947542.772155:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236127744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947542.772162:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783947542.772209:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236127744:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1783947543.332230:0:15097:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783947543.351729:0:15097:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1783947543.351803:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.351821:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.351829:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.351838:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.351872:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783947543.351877:0:15097:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783947543.351905:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947543.351920:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783947543.351926:0:15097:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783947543.351950:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783947543.352009:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947543.352018:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.352026:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947543.352037:0:10390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.352048:0:10390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947543.352056:0:10390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947543.352062:0:10390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947543.352065:0:10390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783947543.352068:0:10390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783947543.352093:0:10390:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.352100:0:10390:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947543.352127:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.352136:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e200/0xe6fd1fdb555001af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001b6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.352149:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947543.352151:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947543.352153:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947543.352170:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236127872:0@lo:39:umount.0 00000100:00100000:1.0:1783947543.352243:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947543.352305:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947543.352314:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236128000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947543.352356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947543.352607:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236127872 00000100:00100000:1.0:1783947543.352614:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236127872 00000100:00100000:1.0:1783947543.352661:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783947543.352671:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870604236127872:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783947543.352699:0:6512:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffd1e 00000100:00080000:1.0:1783947543.352707:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9e7beee92800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783947543.352770:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1870604236127872:12345-0@lo:39:umount.0 Request processed in 99us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947543.352777:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1783947543.352790:0:6512:0:(genops.c:906:class_export_put()) final put ffff9e7beee90800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1783947543.352813:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128000 00000100:00100000:1.0:1783947543.352816:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128000 00000100:00100000:1.0:1783947543.352845:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947543.352851:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3637:x1870604236128000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947543.352863:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947543.352879:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438800/0xe6fd1fdb555001b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555001af expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.352918:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947543.352945:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3637:x1870604236128000:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947543.352951:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783947543.352971:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947543.352980:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7beee90800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783947543.353027:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7beee92800 for lustre-MDT0000 00000100:00100000:1.0:1783947543.353134:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236128000:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783947543.353164:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783947543.353172:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236127872:0@lo:39:umount.0 00000100:00080000:2.0:1783947543.353256:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947543.353259:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783947543.353263:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783947543.356844:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.356862:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.356870:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.356877:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.356937:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947543.356944:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.356950:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.356956:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.356962:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.356991:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947543.356999:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357007:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947543.357010:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357018:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947543.357039:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947543.357045:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947543.357048:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1783947543.357083:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357090:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947543.357128:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357136:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97000/0xe6fd1fdb555001bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001c4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357150:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947543.357153:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357159:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c2000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947543.357162:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357168:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947543.357173:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947543.357178:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947543.357186:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1783947543.357199:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357205:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947543.357212:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.357220:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947543.357221:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947543.357223:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947543.357278:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236128128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947543.357354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.357409:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947543.357415:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236128256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947543.357435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.357561:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128128 00000100:00100000:3.0:1783947543.357568:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128128 00000100:00100000:3.0:1783947543.357614:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128256 00000100:00100000:3.0:1783947543.357617:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128256 00000100:00100000:3.0:1783947543.357639:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947543.357646:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+24:3639:x1870604236128128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947543.357660:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947543.357675:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a200/0xe6fd1fdb555001c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555001bd expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947543.357688:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947543.357722:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+23:3639:x1870604236128128:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947543.357729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947543.357748:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947543.357755:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+22:3639:x1870604236128256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947543.357763:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947543.357771:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c3600/0xe6fd1fdb555000c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb555000c1 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947543.357793:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947543.357817:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3639:x1870604236128256:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947543.357823:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947543.357860:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236128256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947543.357868:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236128128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947543.358349:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783947543.358356:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c2000/0xe6fd1fdb555000c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555000c8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947543.358368:0:15097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783947543.358384:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.358402:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.358410:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.358416:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.358685:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947543.358692:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.358701:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ae00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947543.358704:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.358712:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947543.358720:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947543.358725:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783947543.358728:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1783947543.358752:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.358759:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783947543.358811:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236128384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947543.358852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783947543.358919:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.358935:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947543.358937:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947543.358939:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947543.358982:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128384 00000100:00100000:0.0:1783947543.358989:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128384 00000100:00100000:0.0:1783947543.359033:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947543.359042:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+21:3637:x1870604236128384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947543.359052:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947543.359065:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438400/0xe6fd1fdb5550042c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb55500425 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947543.359077:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947543.359169:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783947543.359175:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55500425 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550042c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947543.359185:0:15097:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783947543.359191:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.359198:0:15097:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.359204:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.359210:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.359223:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783947543.359227:0:15097:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783947543.359236:0:15097:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1783947543.359273:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947543.359278:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.359285:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947543.359288:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.359295:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947543.359302:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947543.359307:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783947543.359309:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783947543.359311:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783947543.359325:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.359331:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947543.359503:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947543.359646:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236128512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947543.359680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947543.360043:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3637:x1870604236128384:12345-0@lo:103:ldlm_bl.0 Request processed in 1001us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947543.360053:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783947543.360070:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128512 00000100:00100000:0.0:1783947543.360074:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128512 00000100:00100000:0.0:1783947543.360278:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947543.360286:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+20:3638:x1870604236128512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947543.360296:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947543.360309:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c02052a00/0xe6fd1fdb554ffc84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe6fd1fdb554ffc7d expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947543.360321:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947543.360360:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2+19:3638:x1870604236128512:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947543.360377:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947543.361368:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236128512:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1783947543.361625:0:15097:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783947543.361630:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783947543.361636:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947543.361642:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1783947543.361647:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7be794e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947543.361654:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7ac588e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947543.361658:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7be7b4b800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947543.361662:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9e7be7a26800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1783947543.361669:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e7ac7c07800 b25d4884-3548-4434-8d96-3aed90ce07dc 192.168.204.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947543.361673:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9e7ac588f800 1eb923ac-790a-478f-897e-124614dbce09 192.168.204.3@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1783947543.361678:0:15097:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9e7bc47b8000) has exports, disconnecting them 00000020:00080000:0.0:1783947543.361683:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7be794e800), last request at 1783947542 00000020:00000080:0.0:1783947543.361690:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550002e 00000100:00080000:0.0:1783947543.361704:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7be7949000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783947543.361753:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be794e800): rc 0 00000020:00000080:0.0:1783947543.361756:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7be794e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783947543.361764:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7ac588e800), last request at 1783947542 00000020:00000080:0.0:1783947543.361768:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fff08 00000100:00080000:0.0:1783947543.361773:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5889000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783947543.361783:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac588e800): rc 0 00000020:00000080:0.0:1783947543.361785:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7ac588e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783947543.361789:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7be7b4b800), last request at 1783947314 00000020:00000080:0.0:1783947543.361793:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffe05 00000100:00080000:0.0:1783947543.361796:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7bffb00800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783947543.361815:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be7b4b800): rc 0 00000020:00000080:0.0:1783947543.361817:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7be7b4b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783947543.361823:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e7be7a26800), last request at 1783947313 00000020:00000080:0.0:1783947543.361827:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffdc6 00000100:00080000:0.0:1783947543.361830:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7be7866000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783947543.361836:0:15097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1783947543.361932:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be7a26800): rc 0 00000004:00000080:0.0:1783947543.361939:0:15097:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb79481c9fae0 00000100:00080000:0.0:1783947543.361956:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783947543.361959:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1783947543.362516:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947543.362527:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be794e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783947543.362574:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac588e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783947543.362596:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b4b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783947543.362622:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7949000 for lustre-MDT0000 00000020:00000080:2.0:1783947543.362628:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5889000 for lustre-MDT0000 00000020:00000080:2.0:1783947543.362631:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bffb00800 for lustre-MDT0000 00010000:00010000:2.0:1783947543.362640:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947543.362845:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783947543.364005:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783947543.364012:0:6489:0:(genops.c:906:class_export_put()) final put ffff9e7be7a26800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783947543.364030:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00080000:2.0:1783947543.364042:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1783947543.364046:0:6489:0:(genops.c:906:class_export_put()) final put ffff9e7ac7c07800/b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00100000:2.0:1783947543.364052:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000001:00080000:2.0:1783947543.364060:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1783947543.364071:0:6489:0:(genops.c:906:class_export_put()) final put ffff9e7ac588f800/1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:2.0:1783947543.364087:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a26800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1783947543.364123:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7c07800/b25d4884-3548-4434-8d96-3aed90ce07dc for lustre-MDT0000 00000020:00000080:2.0:1783947543.364155:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac588f800/1eb923ac-790a-478f-897e-124614dbce09 for lustre-MDT0000 00000020:00000080:2.0:1783947543.364181:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7866000 for lustre-MDT0000 00000020:00000080:2.0:1783947543.364185:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac7c01000 for lustre-MDT0000 00000020:00000080:2.0:1783947543.364189:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac588a800 for lustre-MDT0000 00010000:00010000:1.0:1783947543.364632:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.364645:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96e00/0xe6fd1fdb554ffc7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb554ffc84 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947543.364662:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947543.364664:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947543.364667:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947543.365139:0:15097:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783947543.365170:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4736000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783947543.365232:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236128640:0@lo:39:umount.0 00000100:00100000:1.0:1783947543.365312:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947543.365716:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783947543.365722:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1783947543.365734:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783947543.365793:0:15097:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783947543.365805:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5888800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783947543.365880:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128640 00000100:00100000:2.0:1783947543.365889:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128640 00000100:00100000:2.0:1783947543.365952:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783947543.365961:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1870604236128640:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783947543.365991:0:6516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffe60 00000100:00080000:2.0:1783947543.365999:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9e7bffa42800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783947543.366021:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1783947543.366237:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236128384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947543.366291:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947543.366433:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236128768:0@lo:9:umount.0 00000100:00100000:1.0:1783947543.366703:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947543.366780:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128768 00000100:00100000:3.0:1783947543.366786:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128768 00000100:00100000:3.0:1783947543.366823:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783947543.366830:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1870604236128768:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783947543.366849:0:8427:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fffbe 00000100:00080000:3.0:1783947543.366855:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9e7bffa6d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947543.366892:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1783947543.366998:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3636:x1870604236128768:12345-0@lo:9:umount.0 Request processed in 167us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947543.367006:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1783947543.367028:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947543.367087:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783947543.367091:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1783947543.367139:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783947543.367200:0:15097:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783947543.367214:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73cd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783947543.367261:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e7bc47b8000) has no exports 00000100:00100000:2.0:1783947543.367983:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3636:x1870604236128640:12345-0@lo:39:umount.0 Request processed in 2019us (2666us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783947543.367993:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1783947543.368120:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4736000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783947543.368128:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236128640:0@lo:39:umount.0 00000100:00100000:1.0:1783947543.368144:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236128896:0@lo:9:umount.0 00000100:00100000:1.0:1783947543.368188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783947543.368224:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5888800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783947543.368233:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783947543.368235:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947543.368237:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236128768:0@lo:9:umount.0 00000100:00100000:0.0:1783947543.368300:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236128896 00000100:00100000:0.0:1783947543.368305:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236128896 00000100:00100000:0.0:1783947543.368350:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783947543.368359:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1870604236128896:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783947543.368380:0:8426:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555000f2 00000100:00080000:0.0:1783947543.368407:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783947543.368442:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1783947543.368769:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3636:x1870604236128896:12345-0@lo:9:umount.0 Request processed in 411us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947543.368777:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1783947543.368848:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73cd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783947543.368866:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783947543.368868:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947543.368871:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236128896:0@lo:9:umount.0 00010000:00010000:2.0:1783947543.368982:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783947543.375881:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9e7bc47b8000) has no exports 00000020:00000080:0.0:1783947543.435782:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffcd8 00000020:00000080:0.0:1783947543.435799:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bc64ee000/lustre-QMT0000_UUID 00000020:01000000:0.0:1783947543.435877:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783947543.436801:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc64ee000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783947543.437119:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947543.437131:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783947543.437136:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9e7bc47b99c0) has no exports 00000020:00000080:1.0:1783947543.440148:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffcd1 00000020:00000080:1.0:1783947543.440161:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7beee94000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783947543.440230:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947543.440242:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783947543.440245:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7beee97800/lustre-QMT0000_UUID 00000020:00000080:1.0:1783947543.440248:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7beee97800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783947543.440263:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1783947543.440735:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7beee94000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783947543.440801:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bf7c17660 - data ffff9e7ac5ccd5e8/ffff9e7ac76b0400 00000020:01000000:1.0:1783947543.440951:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bf6802240 - data ffff9e7bead53948/ffff9e7be7855800 00000001:00000004:1.0:1783947543.462735:0:15097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1783947543.506484:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783947543.506493:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783947543.506511:0:15097:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9e7ac76e2300 x1870604236128640/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783947553 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947543.506541:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783947543.511061:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783947543.511070:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1783947543.511091:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947543.511094:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783947543.511716:0:8534:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783947543.511722:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1783947543.511754:0:8534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1783947543.512349:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783947543.512353:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1783947543.512370:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947543.512372:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783947543.512777:0:9931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783947543.512781:0:9931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1783947543.512789:0:9931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783947543.519349:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffca0 00000020:00000080:1.0:1783947543.519362:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783947543.520280:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783947543.522270:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffcb5 00000020:00000080:1.0:1783947543.522281:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783947543.522299:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783947543.522303:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947543.522311:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783947543.522315:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9e7bc47bb380) has no exports 00000020:00000080:2.0:1783947543.522523:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1783947543.522656:0:15097:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783947543.522665:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555000eb 00000020:00000080:1.0:1783947543.522670:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7ac73c9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783947543.522683:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783947543.522687:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947543.522696:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783947543.522698:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9e7ac779b380) has no exports 00000020:00000080:1.0:1783947543.522704:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555000e4 00000020:00000080:1.0:1783947543.522707:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7ac73cb800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783947543.523092:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac73c9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783947543.523099:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac73cb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783947543.523178:0:15097:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783947543.523183:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783947543.523188:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1783947543.523193:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947543.523196:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783947543.523260:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947543.523269:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947543.523275:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fffa9 00000020:00000080:1.0:1783947543.523279:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7c01bf6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783947543.526134:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac73cd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783947543.526170:0:38:0:(genops.c:906:class_export_put()) final put ffff9e7ac73c8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783947543.526174:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac73c8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783947543.526183:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783947543.526762:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783947543.526771:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947543.526786:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783947543.526791:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9e7bf3fb0000) has no exports 00000020:00000080:1.0:1783947543.526801:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fffa2 00000020:00000080:1.0:1783947543.526808:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7ac5888000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783947543.527130:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c01bf6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783947543.527141:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5888000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783947543.527666:0:15097:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783947543.527671:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783947543.527676:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1783947543.527684:0:15097:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947543.527686:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783947543.527769:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783947543.527780:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1783947543.527795:0:15097:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783947543.527801:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffe59 00000020:00000080:1.0:1783947543.527807:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bffa46800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783947543.528236:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5888800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783947543.528244:0:38:0:(genops.c:906:class_export_put()) final put ffff9e7ac588d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783947543.528247:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac588d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783947543.528253:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783947543.528371:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1783947543.528376:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947543.528383:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783947543.528387:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9e7bf3fb3380) has no exports 00000020:00000080:1.0:1783947543.528404:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffe52 00000020:00000080:1.0:1783947543.528409:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bffa6a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783947543.528581:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bffa46800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783947543.528588:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bffa6a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783947543.535509:0:15097:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783947543.535520:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783947543.535525:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1783947543.535535:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783947543.535586:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947543.535601:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947543.535632:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947543.535635:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947543.535642:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bfb1c8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783947543.535647:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bfb1c8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783947543.535656:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783947543.535772:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffcbc 00000020:00000080:2.0:1783947543.535778:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c7800/lustre-MDD0000_UUID 00000020:01000000:2.0:1783947543.535784:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783947543.535788:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947543.535793:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783947543.535797:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9e7bc47bcd40) has no exports 00000020:00000080:2.0:1783947543.535826:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947543.535830:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783947543.535835:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffcc3 00000020:00000080:2.0:1783947543.535839:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c6000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783947543.535849:0:15097:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc9511800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783947543.535853:0:15097:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc9511800 3 00000020:01000004:2.0:1783947543.535856:0:15097:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7bc9511800 from lustre-MDT0000 00000020:00000080:2.0:1783947543.535874:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947543.535878:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783947543.535881:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c3000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783947543.535883:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c3000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783947543.535889:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783947543.535934:0:15097:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783947543.535938:0:15097:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783947543.535941:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783947543.535944:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947543.535947:0:15097:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783947543.535953:0:15097:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9e7bd01b6800 c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947543.535958:0:15097:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9e7bc5513380) has exports, disconnecting them 00000020:00080000:2.0:1783947543.535962:0:15097:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e7bd01b6800), last request at 1783947295 00000020:00000080:2.0:1783947543.535976:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffc61 00000020:00010000:2.0:1783947543.535980:0:15097:0:(genops.c:1954:obd_stale_export_put()) Put export ffff9e7bd01b6800: total 2 00000100:00080000:2.0:1783947543.535984:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9e7bd01b7800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783947543.535997:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bd01b6800): rc 0 00000020:00080000:2.0:1783947543.536001:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9e7bc5513380) has no exports 00000100:00100000:3.0:1783947543.536765:0:6503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e7bc77d2000:6503] 0 exiting: rc = 1 00000100:00100000:3.0:1783947543.536875:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e7bf6864c00:6505] 2 exiting: rc = 0 00000100:00100000:3.0:1783947543.536962:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e7bf6865e00:6504] 1 exiting: rc = 0 00000020:00000080:3.0:1783947543.536999:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc4736000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1783947543.537015:0:38:0:(genops.c:906:class_export_put()) final put ffff9e7bffa69800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783947543.537018:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bffa69800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1783947543.537028:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783947543.537090:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1783947543.537094:0:38:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c7000/lustre-MDD0000_UUID 00000020:00000080:3.0:1783947543.537096:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1783947543.537099:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1783947543.537123:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1783947543.537373:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537382:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537397:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537403:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537409:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537415:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537420:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537451:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537486:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537492:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537499:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537506:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537512:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537517:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537524:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537529:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537535:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537541:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537547:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537552:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537557:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537563:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537569:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537574:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537581:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537587:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537594:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537600:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537605:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537611:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537615:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537620:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537626:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537631:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537637:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537643:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537648:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537653:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537658:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537664:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537669:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537674:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537687:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537693:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537698:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537703:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537708:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537713:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537719:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537724:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537729:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537733:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537738:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537743:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537748:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537753:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537759:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537764:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537769:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537774:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537779:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537786:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537791:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947543.537797:0:15097:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1783947543.539288:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bc0030200/0xe6fd1fdb554ffd5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb554ffd56 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539314:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bc0030200/0xe6fd1fdb554ffd5d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb554ffd56 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539331:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb5550015b expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539350:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97e00/0xe6fd1fdb55500162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb5550015b expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539377:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bffa5fe00/0xe6fd1fdb55500170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb55500169 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539397:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5fe00/0xe6fd1fdb55500170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb55500169 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539407:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bffa5fa00/0xe6fd1fdb5550017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb55500177 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539415:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5fa00/0xe6fd1fdb5550017e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb55500177 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539423:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb5550018c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb55500185 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539444:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb5550018c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb55500185 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539453:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb5550019a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb55500193 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539489:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb5550019a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb55500193 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539497:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb555001a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb555001a1 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539505:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb555001a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb555001a1 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539525:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb555001d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb555001cb expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539535:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac6438a00/0xe6fd1fdb555001d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb555001cb expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539546:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7c021c2400/0xe6fd1fdb55500082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb5550007b expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539554:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c021c2400/0xe6fd1fdb55500082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb5550007b expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539564:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7c02053c00/0xe6fd1fdb554ffd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb554ffd64 expref: 5 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539572:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7c02053c00/0xe6fd1fdb554ffd6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb554ffd64 expref: 5 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539585:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7ac7e50400/0xe6fd1fdb55500402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb555003fb expref: 4 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539594:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e50400/0xe6fd1fdb55500402 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb555003fb expref: 4 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539602:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb55500409 expref: 3 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539609:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5e600/0xe6fd1fdb55500410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb55500409 expref: 3 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539626:0:15097:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb5550041e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xe6fd1fdb55500417 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947543.539635:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb5550041e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xe6fd1fdb55500417 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1783947543.565091:0:6498:0:(genops.c:1940:obd_stale_export_get()) Get export ffff9e7bd01b6800: total 0 00010000:00010000:1.0:1783947543.565180:0:6498:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9e7bd01b6800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1783947543.565201:0:6498:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9e7bd01b6800, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1783947543.565211:0:6498:0:(genops.c:906:class_export_put()) final put ffff9e7bd01b6800/c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2 00010000:00010000:1.0:1783947543.565272:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947543.565275:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947543.565277:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783947543.565306:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd01b6800/c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2 for MGS 00000020:00000080:3.0:1783947543.568131:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bd01b7800 for MGS 00010000:00010000:3.0:1783947543.733148:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947544.308211:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236129024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947544.308293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947544.308536:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236129024 00000100:00100000:1.0:1783947544.308545:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236129024 00000100:00100000:1.0:1783947544.308594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783947544.308602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1870604236129024:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1783947544.308611:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783947544.308663:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1870604236129024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (369us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783947544.308670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:02020000:2.0:1783947544.308816:0:3639:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1783947544.321510:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783947544.321520:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a24800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783947544.321525:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783947544.352321:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947544.352335:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 199 00000100:00080000:2.0:1783947544.352344:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e7be7a24800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947544.355155:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac84b4000 x1870604236129152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947544.355248:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236129152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783947544.355321:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947544.355483:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236129152 00000100:00100000:2.0:1783947544.355491:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236129152 00000100:00100000:2.0:1783947544.355535:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783947544.355543:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236129152:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783947544.355564:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783947544.356004:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236129152:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 459us (681us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947544.356012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:1.0:1783947544.356126:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947544.356132:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947544.356136:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236129152:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1783947544.755663:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783947544.823098:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783947544.823108:0:9507:0:(genops.c:906:class_export_put()) final put ffff9e7c01bf2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783947544.823138:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:1.0:1783947544.823141:0:9507:0:(genops.c:906:class_export_put()) final put ffff9e7ac7cc5000/1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:2.0:1783947544.823570:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c01bf2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783947544.823626:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7cc5000/1eb923ac-790a-478f-897e-124614dbce09 for lustre-OST0001 00000020:00000080:2.0:1783947544.823644:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7c01bf3800 for lustre-OST0001 00000020:00000080:2.0:1783947544.823649:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac7cc3000 for lustre-OST0001 00000001:00100000:3.0:1783947544.823970:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783947544.823981:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1783947544.823985:0:7442:0:(genops.c:906:class_export_put()) final put ffff9e7be7b4d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783947544.824003:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00080000:3.0:1783947544.824008:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1783947544.824010:0:7442:0:(genops.c:906:class_export_put()) final put ffff9e7ac77ca000/b25d4884-3548-4434-8d96-3aed90ce07dc 00000001:00100000:3.0:1783947544.824015:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000001:00080000:3.0:1783947544.824019:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1783947544.824021:0:7442:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c2800/1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:0.0:1783947544.824135:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b4d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783947544.824199:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac77ca000/b25d4884-3548-4434-8d96-3aed90ce07dc for lustre-MDT0001 00000020:00000080:0.0:1783947544.824228:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c2800/1eb923ac-790a-478f-897e-124614dbce09 for lustre-MDT0001 00000020:00000080:0.0:1783947544.824248:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bffa42800 for lustre-MDT0001 00000020:00000080:0.0:1783947544.824252:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac77cd000 for lustre-MDT0001 00000020:00000080:0.0:1783947544.824256:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac65c5800 for lustre-MDT0001 00000001:00100000:0.0:1783947544.824839:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783947544.824844:0:8421:0:(genops.c:906:class_export_put()) final put ffff9e7bffa6c800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783947544.824864:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:0.0:1783947544.824866:0:8421:0:(genops.c:906:class_export_put()) final put ffff9e7c01d49800/1eb923ac-790a-478f-897e-124614dbce09 00000020:00000080:2.0:1783947544.824900:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bffa6c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783947544.825050:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c01d49800/1eb923ac-790a-478f-897e-124614dbce09 for lustre-OST0000 00000020:00000080:2.0:1783947544.825080:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bffa6d800 for lustre-OST0000 00000020:00000080:2.0:1783947544.825084:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7c01d4c800 for lustre-OST0000 00000020:01000000:2.0:1783947545.587547:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bf7c17720 - data ffff9e7beae586c0/ffff9e7ac76b0800 00000020:01000000:2.0:1783947545.587844:0:15097:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bc2b27360 - data ffff9e7beac80af8/ffff9e7bc5dad400 00000020:00000080:2.0:1783947545.588305:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffc45 00000020:00000080:2.0:1783947545.588314:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bd09fc000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783947545.588340:0:15097:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc9511800 from MGS, refs=2 00000020:01000004:2.0:1783947545.588343:0:15097:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc9511800 2 00000020:01000004:2.0:1783947545.588346:0:15097:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7bc9511800 from MGS 00000020:00000080:2.0:1783947545.588366:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947545.588373:0:15097:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783947545.588375:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bd09ff000/MGS 00000020:00000080:2.0:1783947545.588378:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd09ff000/MGS for MGS 00000020:01000000:2.0:1783947545.588384:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783947545.588505:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783947545.588509:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947545.588515:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783947545.588521:0:15097:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e7bfb12a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947545.588528:0:15097:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9e7beeeb8000) has exports, disconnecting them 00000020:00080000:2.0:1783947545.588533:0:15097:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e7bfb12a800), last request at 1783947296 00000020:00000080:2.0:1783947545.588538:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffd10 00000020:00080000:2.0:1783947545.588548:0:15097:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7bfb12a800): rc 0 00000020:00000080:2.0:1783947545.588552:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bfb12a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783947545.588809:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd09fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783947545.588821:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bfb12a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783947545.590934:0:15097:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783947545.590942:0:15097:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783947545.590959:0:15097:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783947545.590966:0:15097:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947545.591152:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947545.591161:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783947545.591168:0:15097:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc9511800 1 00000020:00000080:3.0:1783947545.591174:0:15097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffc37 00000020:00000080:3.0:1783947545.591182:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bd09fa800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783947545.591188:0:15097:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783947545.591191:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947545.591194:0:15097:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783947545.591198:0:15097:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9e7bf3fb19c0) has no exports 00000020:00000080:0.0:1783947545.592177:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc47c0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783947545.592188:0:37:0:(genops.c:906:class_export_put()) final put ffff9e7bc4731000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783947545.592192:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc4731000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783947545.592199:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783947545.592281:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bd09fa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783947545.634549:0:15097:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947545.634561:0:15097:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783947545.634568:0:15097:0:(genops.c:906:class_export_put()) final put ffff9e7bc9514000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783947545.634572:0:15097:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc9514000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783947545.634583:0:15097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783947545.634751:0:15097:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7bc9517800 00000020:02000400:2.0:1783947545.634834:0:15097:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783947545.781562:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947545.852921:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236129280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947545.853008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947545.853086:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236129280 00000100:00100000:3.0:1783947545.853094:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236129280 00000100:00100000:3.0:1783947545.853149:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947545.853158:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236129280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947545.853195:0:13811:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783947545.853252:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac84b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236129280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947545.853260:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1783947545.853282:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947545.853380:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236129280:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783947546.804629:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947547.382090:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947547.382099:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783947547.382103:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a24800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947547.382112:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 429 00000100:00080000:2.0:1783947547.382118:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783947547.382125:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e7be7a24800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947547.382148:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac85ec380 x1870604236129536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947547.382183:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236129408:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.382230:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236129664:0@lo:400:kworker.0 00000400:00000100:0.0:1783947547.382244:0:3637:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870604236129408 offset 0 length 224: 4 00000100:00100000:2.0:1783947547.382732:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.382793:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236130176:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.382957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.382991:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947547.382998:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236130048:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.383024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.383368:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236129536:0@lo:38:kworker.0 00000100:00100000:2.0:1783947547.383402:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.383438:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236129792:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.383620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.383717:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236130304:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.383743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.383767:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783947547.383784:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236129920:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.383806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.383971:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236130432:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.383997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.384037:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236129664 00000100:00100000:2.0:1783947547.384046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236129664 00000100:00100000:2.0:1783947547.384078:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130176 00000100:00100000:2.0:1783947547.384081:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130176 00000100:00100000:2.0:1783947547.384090:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236129792 00000100:00100000:2.0:1783947547.384092:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236129792 00000100:00100000:2.0:1783947547.384098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130304 00000100:00100000:2.0:1783947547.384100:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130304 00000100:00100000:2.0:1783947547.384128:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236129920 00000100:00100000:2.0:1783947547.384131:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236129920 00000100:00100000:2.0:1783947547.384150:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1783947547.384157:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236130304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947547.386128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1783947547.386150:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236129920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947547.386231:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236129920:12345-0@lo:400:kworker.0 Request processed in 92us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947547.386239:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1783947547.386411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783947547.386416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1870604236129664:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783947547.386423:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783947547.386500:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1870604236129664:12345-0@lo:400:kworker.0 Request processed in 81us (3767us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783947547.386506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783947547.386520:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783947547.386525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1870604236130176:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783947547.386529:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783947547.386556:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1870604236130176:12345-0@lo:400:kworker.0 Request processed in 29us (3599us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783947547.386561:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1783947547.386573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783947547.386578:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870604236129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.386578:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236130304:12345-0@lo:400:kworker.0 Request processed in 60us (472us total) trans 0 rc 0/0 00000020:00080000:3.0:1783947547.386582:0:6512:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783947547.386585:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1783947547.386606:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1870604236129792:12345-0@lo:400:kworker.0 Request processed in 26us (2986us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783947547.386611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783947547.386615:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130048 00000100:00100000:2.0:1783947547.386622:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130048 00000100:00100000:3.0:1783947547.386632:0:9303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236129536 00000100:00100000:3.0:1783947547.386636:0:9303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236129536 00000100:00100000:3.0:1783947547.386661:0:9303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783947547.386666:0:9303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1870604236129536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783947547.386686:0:9303:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783947547.386723:0:9303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1870604236129536:12345-0@lo:38:kworker.0 Request processed in 56us (3321us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947547.386726:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130432 00000100:00100000:3.0:1783947547.386730:0:9303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1783947547.386730:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130432 00000100:00100000:2.0:1783947547.386751:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783947547.386758:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236130048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.386798:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236130048:12345-0@lo:400:kworker.0 Request processed in 40us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947547.386803:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783947547.387104:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783947547.387116:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236130432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.387148:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236130432:12345-0@lo:400:kworker.0 Request processed in 33us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947547.387154:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1783947547.387446:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947547.387481:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783947547.387485:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947547.387523:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236130048:0@lo:400:kworker.0 00000100:00080000:3.0:1783947547.387539:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783947547.387543:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783947547.387547:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783947547.391647:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a24800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947547.391661:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783947547.391666:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236129536:0@lo:38:kworker.0 00010000:00080000:2.0:1783947547.392728:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e7ac85eed80 x1870604236129920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947547.392747:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236129920:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.392765:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236130432:0@lo:400:kworker.0 00000100:00080000:2.0:1783947547.392778:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783947547.392782:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7be78be800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783947547.392786:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1783947547.392792:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7be78be800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947547.392796:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 219 00000100:00080000:2.0:1783947547.392805:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e7be78be800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947547.392923:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac6610e00 x1870604236130560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947547.392952:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236129792:0@lo:400:kworker.0 00010000:00080000:2.0:1783947547.392967:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9e7ac85efb80 x1870604236130304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947547.392976:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236130304:0@lo:400:kworker.0 00000100:00100000:2.0:1783947547.393014:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236130560:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1783947547.393075:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947547.393132:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130560 00000100:00100000:2.0:1783947547.393139:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130560 00000100:00100000:2.0:1783947547.393174:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783947547.393180:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236130560:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1783947547.393198:0:6510:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783947547.393238:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236130560:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 56us (161us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947547.393244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1783947547.393271:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be78be800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947547.393275:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783947547.393278:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236130560:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1783947547.417014:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947547.417030:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 199 00000100:00080000:3.0:1783947547.417041:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e7bc47c0800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947547.417081:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac84b5c00 x1870604236130688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947547.417119:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236129664:0@lo:400:kworker.0 00000100:00080000:3.0:1783947547.417153:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783947547.417157:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783947547.417160:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783947547.417164:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947547.417167:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 240 00000100:00080000:3.0:1783947547.417172:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7ac73ca800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947547.417186:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac84b4000 x1870604236130816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947547.417197:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1870604236130176:0@lo:400:kworker.0 00000100:00100000:1.0:1783947547.417250:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236130688:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783947547.417319:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947547.417356:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236130816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783947547.417391:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947547.417545:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130688 00000100:00100000:3.0:1783947547.417553:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130688 00000100:00100000:3.0:1783947547.417593:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130816 00000100:00100000:3.0:1783947547.417596:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130816 00000100:00100000:3.0:1783947547.417615:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783947547.417622:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236130688:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783947547.417643:0:6512:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783947547.417692:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236130688:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 68us (371us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783947547.417699:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783947547.417714:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783947547.417718:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236130816:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1783947547.417726:0:6512:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783947547.417752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236130816:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 33us (361us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783947547.417758:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1783947547.417869:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947547.417875:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947547.417878:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236130688:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1783947547.417885:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783947547.417888:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783947547.417890:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236130816:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1783947547.827763:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947547.895331:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236130944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947547.895406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947547.895511:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236130944 00000100:00100000:0.0:1783947547.895518:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236130944 00000100:00100000:0.0:1783947547.895569:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783947547.895577:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236130944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947547.895609:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783947547.895665:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236130944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947547.895672:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783947547.895722:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236130944:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1783947548.022976:0:13795:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783947548.852812:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783947549.612675:0:15298:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783947549.633619:0:15298:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1783947549.633683:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.633697:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.633703:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.633710:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.633729:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783947549.633735:0:15298:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783947549.633762:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947549.633766:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783947549.633771:0:15298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783947549.633777:0:15298:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c0800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1783947549.633806:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947549.633808:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783947549.633811:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783947549.634826:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634851:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634863:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634875:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634902:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783947549.634910:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634921:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634933:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634941:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634971:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783947549.634977:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.634994:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.635000:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.635007:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.635020:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783947549.635029:0:15298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.635038:0:15298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.635049:0:15298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.635058:0:15298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947549.635069:0:15298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1783947549.635074:0:15298:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1783947549.635113:0:15298:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1783947549.635120:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1783947549.635126:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947549.635134:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783947549.635144:0:15298:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e7ac716d000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783947549.635161:0:15298:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9e7be7863000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783947549.635168:0:15298:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9e7be7b419c0) has exports, disconnecting them 00000020:00080000:1.0:1783947549.635178:0:15298:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e7ac716d000), last request at 1783947547 00000020:00000080:1.0:1783947549.635187:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500043 00000100:00080000:1.0:1783947549.635214:0:15298:0:(import.c:65:import_set_state_nolock()) ffff9e7ac716c000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783947549.635270:0:15298:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac716d000): rc 0 00000020:00000080:1.0:1783947549.635272:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7ac716d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1783947549.635286:0:15298:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9e7be7863000), last request at 1783947547 00000020:00000080:1.0:1783947549.635289:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fff1d 00000100:00080000:1.0:1783947549.635295:0:15298:0:(import.c:65:import_set_state_nolock()) ffff9e7be7865000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783947549.635311:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac716d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1783947549.635359:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac716c000 for lustre-MDT0001 00000020:00080000:1.0:1783947549.635372:0:15298:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be7863000): rc 0 00000020:00000080:1.0:1783947549.635375:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7863000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1783947549.635385:0:15298:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb79481c87ae0 00000020:00000080:1.0:1783947549.635402:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7863000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1783947549.635434:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7865000 for lustre-MDT0001 00000100:00080000:1.0:1783947549.635493:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947549.635508:0:15298:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9e7bf7d6b800 x1870604236129024/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783947560 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947549.635528:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1783947549.636617:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783947549.636630:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636641:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947549.636646:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636655:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947549.636662:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947549.636684:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783947549.636687:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783947549.636690:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783947549.636750:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636756:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947549.636796:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636803:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439200/0xe6fd1fdb55500193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550019a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636816:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783947549.636823:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636831:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947549.636837:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636855:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947549.636864:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947549.636875:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783947549.636877:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1783947549.636881:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1783947549.636910:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636921:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947549.636940:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636949:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439000/0xe6fd1fdb555001a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb555001a8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636960:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783947549.636963:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636969:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c021c3e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947549.636972:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.636978:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947549.636984:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947549.636989:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783947549.636991:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783947549.636992:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783947549.637004:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637010:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947549.637015:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637031:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c021c3e00/0xe6fd1fdb5550007b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb55500082 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637052:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947549.637059:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637067:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947549.637072:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637082:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947549.637093:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947549.637101:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783947549.637106:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783947549.637110:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783947549.637128:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637138:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947549.637147:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637158:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac6439800/0xe6fd1fdb55500417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb5550041e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637185:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947549.637191:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637199:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7c02052000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947549.637204:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637216:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947549.637228:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947549.637236:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783947549.637238:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783947549.637240:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783947549.637252:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637257:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947549.637262:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637268:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02052000/0xe6fd1fdb554ffd64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe6fd1fdb554ffd6b expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947549.637290:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947549.637292:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947549.637303:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947549.637329:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236131072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947549.637413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947549.637515:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236131584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947549.637547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947549.637582:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947549.637588:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236131456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947549.637607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947549.638063:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947549.638072:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947549.638094:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236131072 00000100:00100000:0.0:1783947549.638102:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236131072 00000100:00100000:0.0:1783947549.638152:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236131584 00000100:00100000:0.0:1783947549.638155:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236131584 00000100:00100000:0.0:1783947549.638171:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236131456 00000100:00100000:0.0:1783947549.638174:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236131456 00000100:00100000:0.0:1783947549.638186:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947549.638193:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3638:x1870604236131072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783947549.638208:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947549 with bad export cookie 16644494824720825441 00010000:00010000:2.0:1783947549.638368:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947549.638390:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236131200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947549.638427:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947549.638444:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236129024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947549.638486:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947549.638492:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236131328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947549.638512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947549.638536:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236131200 00000100:00100000:2.0:1783947549.638540:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236131200 00000100:00100000:2.0:1783947549.638556:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236131328 00000100:00100000:2.0:1783947549.638558:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236131328 00000100:00100000:2.0:1783947549.638567:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947549.638572:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870604236131584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783947549.638576:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947549 with bad export cookie 16644494824720825441 00000100:00100000:2.0:1783947549.638624:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870604236131584:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (1078us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783947549.638640:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947549.638657:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947549.638661:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870604236131456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783947549.638665:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947549 with bad export cookie 16644494824720825441 00000100:00100000:2.0:1783947549.638692:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1870604236131456:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (1084us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783947549.638697:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947549.638707:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947549.638710:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1870604236131200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783947549.638714:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947549 with bad export cookie 16644494824720825441 00000100:00100000:2.0:1783947549.638747:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1870604236131200:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (313us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783947549.638753:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947549.638764:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947549.638768:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1870604236131328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783947549.638772:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783947549 with bad export cookie 16644494824720825441 00000100:00100000:2.0:1783947549.638805:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3639:x1870604236131328:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (291us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783947549.638811:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1783947549.638844:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783947549.638929:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7bc64e8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783947549.638933:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1783947549.640185:0:15298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783947549.640195:0:15298:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a24800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1783947549.641150:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783947549.641156:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1783947549.641177:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783947549.641233:0:15298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783947549.641281:0:15298:0:(import.c:65:import_set_state_nolock()) ffff9e7c01b95800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783947549.641300:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783947549.641303:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1783947549.641313:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947549.641384:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236131712:0@lo:9:umount.0 00000100:00100000:1.0:1783947549.641449:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947549.641525:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236131712 00000100:00100000:1.0:1783947549.641532:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236131712 00000100:00100000:1.0:1783947549.641589:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783947549.641598:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1870604236131712:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783947549.641626:0:8539:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fff6a 00000100:00080000:1.0:1783947549.641636:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5830800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783947549.641678:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1783947549.641827:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3636:x1870604236131712:12345-0@lo:9:umount.0 Request processed in 230us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947549.641835:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1783947549.641976:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947549.642006:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c01b95800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783947549.642011:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783947549.642013:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783947549.642016:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236131712:0@lo:9:umount.0 00010000:00010000:1.0:1783947549.642038:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947549.642046:0:15298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783947549.642058:0:15298:0:(import.c:65:import_set_state_nolock()) ffff9e7be794e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783947549.642076:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236131840:0@lo:9:umount.0 00000100:00100000:1.0:1783947549.642102:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1783947549.642149:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9e7be7b419c0) has no exports 00000100:00100000:3.0:1783947549.642247:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236131840 00000100:00100000:3.0:1783947549.642252:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236131840 00000100:00100000:3.0:1783947549.642289:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783947549.642296:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1870604236131840:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783947549.642311:0:8429:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555000ac 00000100:00080000:3.0:1783947549.642317:0:8429:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783947549.642345:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1783947549.642444:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3636:x1870604236131840:12345-0@lo:9:umount.0 Request processed in 148us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947549.642451:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1783947549.642486:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947549.642503:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be794e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783947549.642507:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783947549.642508:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783947549.642511:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236131840:0@lo:9:umount.0 00000100:00080000:3.0:1783947549.643581:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1783947549.656819:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3638:x1870604236131072:12345-0@lo:103:ldlm_bl.0 Request processed in 18619us (19401us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783947549.656835:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1783947549.657351:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947549.681268:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.103@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783947549.681384:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783947549.681395:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac85ed880 x1870604236129408/t0(0) o400->MGC192.168.204.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783947563 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947549.681544:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac84b4000 x1870604236131072/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947565 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947549.681554:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac7c91880 x1870604236131584/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947565 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947549.681564:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac7c90000 x1870604236131456/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947565 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947549.681573:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac84b5c00 x1870604236131200/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947565 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947549.681583:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac7c90a80 x1870604236131328/t0(0) o103->MGC192.168.204.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783947565 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947549.681628:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e7bc64e8800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:2.0:1783947549.681717:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783947549.681720:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783947549.681721:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783947549.681725:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9e7bc64e8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947549.681730:0:3639:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 181 00000100:00080000:2.0:1783947549.681750:0:3639:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import ffff9e7bc64e8800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947549.681806:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac6611f80 x1870604236131968/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947549.681862:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604236131968:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1783947549.681908:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870604236131968 offset 0 length 520: 4 00000100:00100000:2.0:1783947549.682037:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236131200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947549.682062:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3639:1870604236131328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947549.682166:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3637:1870604236129408:0@lo:400:kworker.0 00000100:00100000:0.0:1783947549.682198:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac84b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236131072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947549.682205:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236131584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783947549.682224:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3638:1870604236131456:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783947549.687762:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9e7be7b419c0) has no exports 00000020:01000000:1.0:1783947549.756199:0:15298:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bc55b29c0 - data ffff9e7beaf14510/ffff9e7ac759cc00 00000020:01000000:1.0:1783947549.756373:0:15298:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bff896840 - data ffff9e7bead93af8/ffff9e7bff806c00 00000001:00000004:1.0:1783947549.771120:0:15298:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1783947549.831545:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947549.831558:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1783947549.831569:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783947549.841653:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783947549.841661:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1783947549.841675:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783947549.845468:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783947549.846488:0:8529:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783947549.846494:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1783947549.846507:0:8529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783947549.848119:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783947549.848126:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1783947549.848184:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783947549.848188:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783947549.851360:0:9923:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783947549.851371:0:9923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1783947549.851406:0:9923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1783947549.854360:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffd87 00000020:00000080:2.0:1783947549.854371:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7bfb1c8800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783947549.855065:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bfb1c8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783947549.856619:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffd9c 00000020:00000080:2.0:1783947549.856630:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7b4e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783947549.856643:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1783947549.856648:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947549.856657:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783947549.856661:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9e7be7b44d40) has no exports 00000020:00000080:3.0:1783947549.856825:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b4e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1783947549.856874:0:15298:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783947549.856884:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb555000a5 00000020:00000080:2.0:1783947549.856889:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783947549.856904:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1783947549.856908:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947549.856915:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783947549.856917:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9e7c01b8b380) has no exports 00000020:00000080:2.0:1783947549.856924:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550009e 00000020:00000080:2.0:1783947549.856927:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be794f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783947549.857143:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783947549.857153:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be794f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1783947549.857360:0:15298:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1783947549.857367:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783947549.857371:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1783947549.857378:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783947549.857381:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783947549.857422:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947549.857423:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be794e000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1783947549.857431:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783947549.857435:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783947549.857438:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1783947549.857443:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783947549.857549:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fff63 00000020:00000080:2.0:1783947549.857564:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7bffb03000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783947549.857580:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1783947549.857584:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947549.857589:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783947549.857592:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9e7c01b899c0) has no exports 00000020:00000080:2.0:1783947549.857597:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fff5c 00000020:00000080:2.0:1783947549.857601:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7c01b91800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783947549.857775:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bffb03000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783947549.857791:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c01b91800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1783947549.857982:0:15298:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1783947549.857986:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783947549.857989:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1783947549.857992:0:15298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783947549.857994:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783947549.858038:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947549.858044:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1783947549.858055:0:15298:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783947549.858060:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffdbf 00000020:00000080:2.0:1783947549.858065:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7a21800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783947549.858070:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1783947549.858073:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947549.858078:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783947549.858080:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9e7beeeb99c0) has no exports 00000020:00000080:2.0:1783947549.858085:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffdb8 00000020:00000080:2.0:1783947549.858088:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7a27800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783947549.858198:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7c01b95800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783947549.858205:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7bffa6e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783947549.858208:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bffa6e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1783947549.858213:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947549.858284:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a21800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783947549.858290:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a27800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783947549.859546:0:15298:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1783947549.859553:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783947549.859557:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1783947549.859563:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947549.859822:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be7a24800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783947549.859909:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947549.859919:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947549.859923:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7a20800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783947549.859927:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a20800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1783947549.859934:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947549.860129:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947549.860134:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947549.860147:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783947549.860150:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1783947549.860154:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947549.860265:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffda3 00000020:00000080:3.0:1783947549.860272:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7b4e800/lustre-MDD0001_UUID 00000020:01000000:3.0:1783947549.860290:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1783947549.860295:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947549.860300:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783947549.860305:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9e7be7b43380) has no exports 00000020:00000080:3.0:1783947549.860325:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947549.860328:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1783947549.860332:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffdaa 00000020:00000080:3.0:1783947549.860335:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7b49000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1783947549.860345:0:15298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7be784d800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783947549.860348:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b4e800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:3.0:1783947549.860349:0:15298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7be784d800 2 00000020:01000004:3.0:1783947549.860354:0:15298:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7be784d800 from lustre-MDT0001 00000020:00000080:0.0:1783947549.860356:0:36:0:(genops.c:906:class_export_put()) final put ffff9e7bc47c6800/lustre-MDD0001_UUID 00000020:00000080:0.0:1783947549.860360:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc47c6800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1783947549.860365:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1783947549.860378:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947549.860382:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1783947549.860385:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7bfb1cb800/lustre-MDT0001_UUID 00000020:00000080:3.0:1783947549.860387:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bfb1cb800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1783947549.860396:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1783947549.860436:0:15298:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1783947549.860439:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1783947549.860443:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947549.860446:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783947549.860454:0:15298:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9e7be7b48800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783947549.860484:0:15298:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9e7be7b40000) has exports, disconnecting them 00000020:00080000:3.0:1783947549.860489:0:15298:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9e7be7b48800), last request at 1783947314 00000020:00000080:3.0:1783947549.860494:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffdfe 00000020:00080000:3.0:1783947549.860507:0:15298:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7be7b48800): rc 0 00000020:00000080:3.0:1783947549.860517:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7b48800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1783947549.860630:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b49000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1783947549.860635:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b48800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1783947549.871704:0:15298:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1783947549.871714:0:15298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783947549.871719:0:15298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783947549.871727:0:15298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783947549.871910:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947549.871921:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1783947549.871930:0:15298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7be784d800 1 00000020:00000080:0.0:1783947549.871937:0:15298:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffd3a 00000020:00000080:0.0:1783947549.871945:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7861000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1783947549.871951:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1783947549.871956:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947549.871960:0:15298:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783947549.871964:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9e7beeebcd40) has no exports 00000020:00000080:1.0:1783947549.876223:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc47c0800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783947549.876242:0:37:0:(genops.c:906:class_export_put()) final put ffff9e7be7b4a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1783947549.876245:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b4a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1783947549.876259:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1783947549.876388:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7861000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:0.0:1783947549.981940:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783947550.058684:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947550.058699:0:15298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1783947550.058705:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7be7a23000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783947550.058710:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a23000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1783947550.058721:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1783947550.061254:0:15298:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7be784e000 00000020:01000000:2.0:1783947550.061286:0:15298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1783947550.061291:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947550.061296:0:15298:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783947550.061311:0:15298:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9e7bc5514d40) has no exports 00000100:00100000:2.0:1783947550.061920:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e7bd1511000:6512] 2 exiting: rc = 0 00000100:00100000:2.0:1783947550.062027:0:6510:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e7bd1511200:6510] 0 exiting: rc = 1 00000100:00100000:3.0:1783947550.062128:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e7bc4d17800:6511] 1 exiting: rc = 0 00000100:00100000:0.0:1783947550.062445:0:8291:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e7be7819200:8291] 3 exiting: rc = 0 00000100:00100000:0.0:1783947550.062565:0:12193:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e7ac6631c00:12193] 4 exiting: rc = 0 00000100:00100000:2.0:1783947550.062687:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062697:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062704:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062710:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062715:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062721:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062727:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062733:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062738:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062744:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062750:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062755:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062761:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062766:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062772:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062787:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062794:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062799:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062805:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062810:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062816:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062822:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062828:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062833:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062838:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062843:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062848:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062853:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062859:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062864:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062869:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062875:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062891:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062896:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062901:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062906:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062910:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062915:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062921:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062926:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062932:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062938:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062944:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062948:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062953:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062959:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062964:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062971:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062978:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062983:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062988:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062994:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.062999:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063004:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063009:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063015:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063019:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063024:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063029:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063034:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063039:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063044:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063049:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.063056:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947550.065577:0:14165:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9e7ac7591a00:14165] 2 exiting: rc = 0 00000100:00100000:3.0:1783947550.065750:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e7bc874d600:6514] 1 exiting: rc = 0 00000100:00100000:3.0:1783947550.065844:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e7bc874cc00:6513] 0 exiting: rc = 1 00000100:00100000:2.0:1783947550.066079:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066088:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066093:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066114:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066119:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066125:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066130:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066136:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066142:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066147:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066152:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066160:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066167:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066172:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066177:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066182:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066187:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066192:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066198:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066203:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066209:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066214:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066220:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066225:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066230:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066234:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066239:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.066245:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067637:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067644:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067650:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067655:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067660:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067665:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067669:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067674:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067679:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067685:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067708:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067713:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067718:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067722:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067728:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067734:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067739:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067749:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067754:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067759:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067765:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067770:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067775:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067790:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067795:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067800:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067805:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067810:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067815:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067821:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067825:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067830:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067835:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067840:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067845:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.067849:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947550.069562:0:9303:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9e7ac6578400:9303] 2 exiting: rc = 0 00000100:00100000:3.0:1783947550.080796:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e7bc9449400:6516] 1 exiting: rc = 0 00000100:00100000:3.0:1783947550.090421:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e7bc63ef600:6515] 0 exiting: rc = 1 00000100:00100000:2.0:1783947550.090773:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090805:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090815:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090840:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090847:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090854:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090860:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090867:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090874:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090899:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090908:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090915:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090922:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090928:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090934:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090956:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090965:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090971:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090976:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090983:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090989:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.090995:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091001:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091008:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091016:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091021:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091027:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091047:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091056:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091062:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091068:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091074:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091080:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091085:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091090:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091096:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091102:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091108:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091114:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091135:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091143:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091149:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091154:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091159:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091175:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091181:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091187:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091194:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091201:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091210:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091217:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091238:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091245:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091251:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091256:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091262:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091268:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091275:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091281:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091287:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091293:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091300:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091307:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947550.091320:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947550.104564:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e7bc3693c00:6518] 1 exiting: rc = 0 00000100:00100000:0.0:1783947550.105234:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e7bc3693000:6517] 0 exiting: rc = 1 00000100:00100000:3.0:1783947550.105342:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105350:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105356:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105361:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105367:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105372:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105378:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105383:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105389:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105393:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105398:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105402:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105407:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105412:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105417:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105422:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105427:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105432:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105438:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105443:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105447:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105452:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105498:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105504:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105509:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105513:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105518:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105523:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105541:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105546:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105551:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105556:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105561:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105566:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105571:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105577:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105582:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105587:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105593:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105598:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105603:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105616:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105622:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105627:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105632:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105637:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105642:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105647:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105652:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105656:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105661:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105665:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105670:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105675:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105681:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105687:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105692:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105696:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105702:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105707:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105713:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105718:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105723:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.105736:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947550.106290:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e7bd10a4200:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1783947550.106494:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e7bc559b600:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1783947550.106864:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106872:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106877:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106882:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106888:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106894:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106900:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106905:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106911:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106916:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106922:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106927:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106932:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106937:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106942:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106947:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106952:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106957:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106961:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106966:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106971:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106977:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106982:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106986:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106991:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.106995:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107145:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107154:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107159:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107163:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107168:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107173:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107177:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107182:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107199:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107203:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107208:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107213:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107217:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107221:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107226:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107231:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107236:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107241:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107245:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107303:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107308:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107313:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107318:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107323:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107328:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107333:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107339:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107344:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107350:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107355:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107361:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107366:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107371:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107376:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107381:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107386:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107391:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.107396:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947550.108835:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e7bd57a5a00:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1783947550.109015:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e7bc71aaa00:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1783947550.109125:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109132:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109138:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109143:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109150:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109167:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109173:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109178:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109183:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109188:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109193:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109197:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109202:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109207:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109212:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109218:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109223:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109228:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109233:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109238:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109243:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109299:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109305:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109311:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109316:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109321:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109326:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109331:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109336:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109341:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109345:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109350:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109354:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109360:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109366:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109370:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109375:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109380:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109385:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109390:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109403:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109407:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109413:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109418:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109424:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109429:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109434:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109440:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109445:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109449:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109700:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109709:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109714:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109719:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109724:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109729:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109734:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109739:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109744:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109749:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109755:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109760:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109765:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.109770:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947550.112508:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e7bc4c96800:6523] 0 exiting: rc = 1 00000100:00100000:0.0:1783947550.112792:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e7bd0b0c800:6525] 2 exiting: rc = 0 00000100:00100000:1.0:1783947550.113803:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e7bd5f73400:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1783947550.115125:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.115134:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.115140:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.115146:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.115170:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.115176:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.115181:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117071:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117079:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117085:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117090:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117112:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117118:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117122:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117127:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117132:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117138:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117143:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117148:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117153:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117159:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117166:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117172:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117177:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117183:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117188:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117193:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117199:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117223:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117230:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117236:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117242:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117247:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117253:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117260:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117265:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117271:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117277:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117282:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117287:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117292:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117297:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117303:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117309:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117314:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117319:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117333:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117339:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117344:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117349:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117354:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117360:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117381:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117389:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117393:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117399:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117405:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117411:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117417:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117423:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117428:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117433:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117440:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947550.117446:0:15298:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783947550.127869:0:15298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947550.127882:0:15298:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783947550.127888:0:15298:0:(genops.c:906:class_export_put()) final put ffff9e7bc64e8000/MDS_uuid 00000020:00000080:2.0:1783947550.127892:0:15298:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc64e8000/MDS_uuid for MDS 00000020:01000000:2.0:1783947550.127903:0:15298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783947550.128072:0:15298:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1783947551.027963:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947552.061612:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783947552.501265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947552.501282:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783947552.501286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947552.501292:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783947552.501297:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7be78be800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947552.501307:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1783947552.501313:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783947552.501322:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e7be78be800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947552.501380:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d68700 x1870604236132096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947552.501498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783947552.501502:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783947552.501504:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947552.501523:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1783947552.501526:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783947552.501530:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7ac73ca800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947552.501534:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947552.501554:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d69880 x1870604236132352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947552.501555:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236132224:0@lo:400:kworker.0 00000400:00000100:0.0:1783947552.501613:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236132224 offset 0 length 224: 4 00000100:00100000:0.0:1783947552.501682:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236132480:0@lo:400:kworker.0 00000400:00000100:0.0:1783947552.501701:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236132480 offset 0 length 224: 4 00000100:00100000:3.0:1783947552.502331:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236132096:0@lo:38:kworker.0 00000400:00000100:3.0:1783947552.502362:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236132096 offset 0 length 520: 4 00000100:00100000:3.0:1783947552.502377:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236132352:0@lo:38:kworker.0 00000400:00000100:3.0:1783947552.502406:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236132352 offset 0 length 520: 4 00010000:00010000:3.0:1783947553.079671:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783947553.843693:0:15498:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783947553.863789:0:15498:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1783947553.863856:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947553.863873:0:15498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947553.863881:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947553.863889:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947553.863913:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783947553.863920:0:15498:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783947553.863952:0:15498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947553.863965:0:15498:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7d68700 x1870604236132096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947553.863977:0:15498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783947553.863983:0:15498:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783947553.863990:0:15498:0:(import.c:65:import_set_state_nolock()) ffff9e7be78be800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783947553.863996:0:15498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783947553.864001:0:15498:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7d68700 x1870604236132096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947567 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947553.864025:0:15498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783947553.864029:0:15498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1783947553.864034:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236132096:0@lo:38:kworker.0 00000100:00080000:1.0:1783947553.864942:0:15498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783947553.864952:0:15498:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7d69c00 x1870604236132224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947553.864983:0:15498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783947553.864988:0:15498:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1783947553.865013:0:15498:0:(import.c:65:import_set_state_nolock()) ffff9e7bffa6f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1783947553.865097:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947553.865110:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947553.865120:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:0.0:1783947553.865135:0:10390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947553.865146:0:10390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947553.865153:0:10390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947553.865158:0:10390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947553.865162:0:10390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783947553.865165:0:10390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783947553.865180:0:10390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:0.0:1783947553.865184:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947553.865192:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9b000/0xe6fd1fdb55500177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb5550017e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947553.865207:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947553.865209:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947553.865211:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947553.865215:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236132224:0@lo:400:kworker.0 00000100:00100000:3.0:1783947553.865255:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236132608:0@lo:39:umount.0 00000400:00000100:3.0:1783947553.865308:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236132608 offset 0 length 224: 4 00010000:00010000:2.0:1783947554.099737:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783947554.550711:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783947554.550726:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947554.550754:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783947554.550759:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783947554.550934:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947554.550966:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236132736:0@lo:400:kworker.0 00000400:00000100:1.0:1783947554.551032:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236132736 offset 0 length 224: 4 00010000:00010000:1.0:1783947555.123738:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783947555.575783:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783947555.575793:0:9507:0:(genops.c:906:class_export_put()) final put ffff9e7c01bf6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783947555.575871:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7c01bf6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783947555.575935:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7c01bf5800 for lustre-OST0001 00000001:00100000:0.0:1783947555.576027:0:8421:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783947555.576042:0:8421:0:(genops.c:906:class_export_put()) final put ffff9e7ac5830000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783947555.580064:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5830000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783947555.580145:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac5830800 for lustre-OST0000 00010000:00010000:3.0:1783947556.148063:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947557.172686:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947557.555704:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947557.555714:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947557.555717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947557.555720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947557.555830:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236132864:0@lo:400:kworker.0 00000400:00000100:3.0:1783947557.556026:0:3638:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236132864 offset 0 length 224: 4 00010000:00010000:2.0:1783947558.195662:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947559.220091:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947559.988221:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947549/real 1783947549] req@ffff9e7ac6611f80 x1870604236131968/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783947559 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947559.988253:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac6611f80 x1870604236131968/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783947559 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947559.988274:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc64e8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947559.988299:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783947559.988303:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604236131968:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1783947559.988377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947559.988383:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783947559.988386:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc64e8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947559.988391:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1783947559.988396:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783947559.988421:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import ffff9e7bc64e8800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947559.988451:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e1880 x1870604236132992/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947559.988496:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947559.988501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783947559.988612:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236133120:0@lo:400:kworker.0 00000400:00000100:2.0:1783947559.988659:0:3639:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236133120 offset 0 length 224: 4 00000100:00100000:3.0:1783947559.989271:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604236132992:0@lo:250:kworker.0 00000400:00000100:3.0:1783947559.989297:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870604236132992 offset 0 length 520: 4 00010000:00010000:3.0:1783947560.244478:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947561.270231:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947562.291750:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947563.059616:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947553/real 1783947553] req@ffff9e7bf7d68700 x1870604236132608/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947563 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947563.059671:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf7d68700 x1870604236132608/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947563 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947563.059700:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bffa6f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783947563.059730:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236132608:0@lo:39:umount.0 00000100:00080000:1.0:1783947563.059987:0:15498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783947563.059994:0:15498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783947563.059999:0:15498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783947563.064598:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.064627:0:15498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.064634:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.064641:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.064919:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947563.064931:0:15498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.064938:0:15498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.064944:0:15498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947563.064949:0:15498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.068697:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947563.068723:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.068737:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5fc00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947563.068765:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.068778:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947563.068787:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947563.068793:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783947563.068797:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1783947563.068815:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:3.0:1783947563.068819:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.068827:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5fc00/0xe6fd1fdb55500185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb5550018c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.068984:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947563.068992:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.068999:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947563.069002:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.069010:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947563.069016:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947563.069032:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783947563.069035:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1783947563.069040:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:3.0:1783947563.069043:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947563.069051:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947563.069053:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947563.069055:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947563.069618:0:15498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783947563.069631:0:15498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50800/0xe6fd1fdb55500409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500410 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947563.069647:0:15498:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1783947563.069656:0:15498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1783947563.069659:0:15498:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783947563.069707:0:15498:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783947563.069713:0:15498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783947563.069723:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783947563.069730:0:15498:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783947563.069735:0:15498:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9e7bf7f70000) has no exports 00000020:00080000:1.0:1783947563.069769:0:15498:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9e7bf7f70000) has no exports 00010000:00010000:3.0:1783947563.071020:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783947563.080002:0:15498:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac75c7a20 - data ffff9e7beaf1bd80/ffff9e7be788a000 00000020:01000000:1.0:1783947563.080215:0:15498:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7ac58728a0 - data ffff9e7beae75a20/ffff9e7ac6574800 00100000:10000000:1.0:1783947563.092973:0:15498:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783947563.098911:0:15498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffed7 00000020:00000080:0.0:1783947563.098925:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7ac5836000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1783947563.099007:0:15498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bff958800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1783947563.099021:0:15498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bff958800 2 00000020:01000004:0.0:1783947563.099025:0:15498:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7bff958800 from lustre-OST0000 00000020:00000080:0.0:1783947563.099047:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947563.099060:0:15498:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1783947563.099065:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7ac5832800/lustre-OST0000_UUID 00000020:00000080:0.0:1783947563.099068:0:15498:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5832800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1783947563.099078:0:15498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1783947563.099155:0:15498:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1783947563.099166:0:15498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783947563.099171:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947563.099176:0:15498:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783947563.099187:0:15498:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e7ac5835000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947563.099203:0:15498:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9e7beeebb380) has exports, disconnecting them 00000020:00080000:0.0:1783947563.099209:0:15498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e7ac5835000), last request at 1783947334 00000020:00000080:0.0:1783947563.099213:0:15498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fff01 00000020:00080000:0.0:1783947563.099223:0:15498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac5835000): rc 0 00000020:00000080:0.0:1783947563.099228:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7ac5835000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783947563.103091:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5836000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783947563.110803:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5835000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783947563.130585:0:15498:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783947563.130594:0:15498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947563.130599:0:15498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783947563.130607:0:15498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947563.130907:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7be78be800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783947563.130998:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947563.131007:0:15498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783947563.131013:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7bffa6b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783947563.131017:0:15498:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bffa6b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783947563.131026:0:15498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1783947563.131105:0:15498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783947563.131109:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947563.131114:0:15498:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783947563.131121:0:15498:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9e7ac5831000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783947563.131127:0:15498:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9e7bf7f74d40) has exports, disconnecting them 00000020:00080000:2.0:1783947563.131131:0:15498:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9e7ac5831000), last request at 1783947334 00000020:00000080:2.0:1783947563.131136:0:15498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fff16 00000020:00080000:2.0:1783947563.131152:0:15498:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac5831000): rc 0 00000020:00000080:2.0:1783947563.131156:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7ac5831000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783947563.131562:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5831000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1783947563.133913:0:15498:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783947563.133923:0:15498:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783947563.133926:0:15498:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783947563.133941:0:15498:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947563.133976:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bffa6f800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1783947563.134128:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947563.134141:0:15498:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1783947563.134146:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7ac5832000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1783947563.134150:0:15498:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac5832000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1783947563.134157:0:15498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1783947563.134229:0:15498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bff958800 1 00000020:00000080:3.0:1783947563.134236:0:15498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffe9f 00000020:00000080:3.0:1783947563.134242:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7be7a22800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1783947563.134251:0:15498:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783947563.134268:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a22800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783947563.134276:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947563.134281:0:15498:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783947563.134284:0:15498:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9e7bc55119c0) has no exports 00000020:00000080:3.0:1783947563.221319:0:15498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947563.221411:0:15498:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783947563.221418:0:15498:0:(genops.c:906:class_export_put()) final put ffff9e7bff95b800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783947563.221423:0:15498:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bff95b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783947563.221434:0:15498:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783947563.221738:0:15498:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7bff95a800 00000020:02000400:3.0:1783947563.221791:0:15498:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1783947563.318935:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947564.339616:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947565.309669:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947565.309679:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783947565.309682:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947565.309698:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783947565.309778:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236133248:0@lo:400:kworker.0 00000400:00000100:1.0:1783947565.309851:0:3640:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236133248 offset 0 length 224: 4 00010000:00010000:3.0:1783947565.363701:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947566.393209:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783947566.544279:0:15700:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783947566.557600:0:15700:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783947566.557720:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557741:0:15700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557749:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557758:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557780:0:15700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783947566.557787:0:15700:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1783947566.557823:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947566.557832:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557841:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947566.557845:0:10390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557854:0:10390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947566.557862:0:10390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947566.557883:0:10390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947566.557886:0:10390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783947566.557889:0:10390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783947566.557906:0:10390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:2.0:1783947566.557910:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557917:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb5550015b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500162 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947566.557927:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947566.557929:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947566.557931:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947566.557947:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947566.557961:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7d69880 x1870604236132352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947566.557981:0:15700:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783947566.557988:0:15700:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783947566.557997:0:15700:0:(import.c:65:import_set_state_nolock()) ffff9e7ac73ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783947566.558004:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783947566.558008:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7d69880 x1870604236132352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783947567 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947566.558016:0:15700:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783947566.558019:0:15700:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:2.0:1783947566.558072:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236132352:0@lo:38:kworker.0 00000100:00080000:2.0:1783947566.559033:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783947566.559047:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7bf7d6ad80 x1870604236132480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947566.559091:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac7c90380 x1870604236132736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947566.559106:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac6611500 x1870604236132864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947573 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947566.559115:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac76e1500 x1870604236133120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947575 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947566.559137:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac6613100 x1870604236133248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947581 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947566.559145:0:15700:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1783947566.559185:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236132864:0@lo:400:kworker.0 00000100:00100000:2.0:1783947566.559194:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236132736:0@lo:400:kworker.0 00000100:00080000:2.0:1783947566.559231:0:15700:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783947566.559260:0:15700:0:(import.c:65:import_set_state_nolock()) ffff9e7ac716b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783947566.559293:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236133376:0@lo:39:umount.0 00000400:00000100:2.0:1783947566.559359:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870604236133376 offset 0 length 224: 4 00000100:00100000:2.0:1783947566.559502:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236133120:0@lo:400:kworker.0 00000100:00100000:2.0:1783947566.559536:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236133248:0@lo:400:kworker.0 00000100:00100000:2.0:1783947566.559547:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236132480:0@lo:400:kworker.0 00010000:00010000:2.0:1783947567.412544:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947568.435751:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947569.459891:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947570.419608:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783947570.419625:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1783947570.483669:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947571.507684:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947572.532283:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947573.556280:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947574.579942:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947574.772644:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947559/real 1783947559] req@ffff9e7ac76e1880 x1870604236132992/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783947574 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947574.772706:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac76e1880 x1870604236132992/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783947574 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783947574.772733:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc64e8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947574.772768:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783947574.772773:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604236132992:0@lo:250:kworker.0 00000100:00080000:0.0:1783947574.773687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783947574.773696:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783947574.773701:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc64e8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947574.773708:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 445 00000100:00080000:0.0:1783947574.773714:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.103@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947574.773724:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import ffff9e7bc64e8800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947574.773782:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e1880 x1870604236133504/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947574.773938:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604236133504:0@lo:250:kworker.0 00000400:00000100:2.0:1783947574.774021:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870604236133504 offset 0 length 520: 4 00010000:00010000:2.0:1783947575.603809:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947576.629380:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947576.819639:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947566/real 1783947566] req@ffff9e7ac6611500 x1870604236133376/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947576.819701:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac6611500 x1870604236133376/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783947576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783947576.819727:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac716b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783947576.819762:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236133376:0@lo:39:umount.0 00000100:00080000:0.0:1783947576.820252:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783947576.820417:0:15700:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783947576.820426:0:15700:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783947576.824639:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.824657:0:15700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.824664:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.824671:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.825250:0:15700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947576.825261:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.825275:0:15700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.825282:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.825288:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.825311:0:15700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783947576.825317:0:15700:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783947576.825348:0:15700:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783947576.825353:0:15700:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783947576.825358:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947576.825364:0:15700:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783947576.825368:0:15700:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9e7ac66f0000) has no exports 00000020:00080000:0.0:1783947576.825391:0:15700:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9e7ac66f0000) has no exports 00010000:00010000:2.0:1783947576.825823:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947576.825831:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825840:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947576.825843:0:10390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825866:0:10390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947576.825874:0:10390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947576.825879:0:10390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783947576.825882:0:10390:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1783947576.825884:0:10390:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1783947576.825898:0:10390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:2.0:1783947576.825901:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825908:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb55500169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500170 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825920:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947576.825923:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825929:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947576.825931:0:10390:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825937:0:10390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947576.825943:0:10390:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947576.825958:0:10390:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783947576.825960:0:10390:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783947576.825962:0:10390:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783947576.825967:0:10390:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:2.0:1783947576.825970:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825976:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5f600/0xe6fd1fdb555003fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb55500402 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947576.825988:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947576.825990:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947576.825992:0:10390:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947576.826232:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783947576.833889:0:15700:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bff8968a0 - data ffff9e7beaf07438/ffff9e7bf7f31400 00000020:01000000:0.0:1783947576.834130:0:15700:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9e7bf7c179c0 - data ffff9e7beaf14870/ffff9e7ac7708c00 00100000:10000000:0.0:1783947576.849488:0:15700:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783947576.864330:0:15700:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffffd 00000020:00000080:0.0:1783947576.864344:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7ac716a800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1783947576.864369:0:15700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc47c2000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783947576.864374:0:15700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc47c2000 2 00000020:01000004:0.0:1783947576.864377:0:15700:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e7bc47c2000 from lustre-OST0001 00000020:00000080:0.0:1783947576.864412:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947576.864421:0:15700:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783947576.864424:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7ac7168800/lustre-OST0001_UUID 00000020:00000080:0.0:1783947576.864427:0:15700:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac7168800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783947576.864435:0:15700:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1783947576.864611:0:15700:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2->MGS 00010000:00010000:0.0:1783947576.864638:0:15700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7c02053400/0xe6fd1fdb554ffd56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb554ffd5d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947576.864651:0:15700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7c02053400/0xe6fd1fdb554ffd56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb554ffd5d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947576.864658:0:15700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783947576.864661:0:15700:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783947576.864665:0:15700:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783947576.864679:0:15700:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:0.0:1783947576.864683:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7c02053400/0xe6fd1fdb554ffd56 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb554ffd5d expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947576.864875:0:15700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe6fd1fdb555001d2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783947576.864884:0:15700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe6fd1fdb555001d2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947576.864890:0:15700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783947576.864892:0:15700:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783947576.864894:0:15700:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783947576.864904:0:15700:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e7bc64e8800 00010000:00010000:0.0:1783947576.864908:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7bdda96800/0xe6fd1fdb555001cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe6fd1fdb555001d2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783947576.864938:0:15700:0:(import.c:65:import_set_state_nolock()) ffff9e7bc64e8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783947576.864943:0:15700:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783947576.864945:0:15700:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783947576.864947:0:15700:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783947576.864952:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783947576.864964:0:15700:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e7ac76e1880 x1870604236133504/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783947594 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783947576.864979:0:15700:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783947576.864982:0:15700:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000020:00000080:2.0:1783947576.865188:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac716a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1783947576.865228:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2:3636:1870604236133504:0@lo:250:kworker.0 10000000:01000000:0.0:1783947576.865299:0:15700:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783947576.865307:0:15700:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554ffc53 00000020:00000080:0.0:1783947576.865311:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7bc64eb800/c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2 00000020:01000000:0.0:1783947576.865329:0:15700:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.103@tcp (flags='') 00000020:00000080:0.0:1783947576.865333:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947576.865339:0:15700:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783947576.865343:0:15700:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9e7bc5510000) has no exports 10000000:01000000:0.0:1783947576.865359:0:6507:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783947576.865407:0:15700:0:(obd_class.h:673:obd_cleanup_client_import()) MGC192.168.204.103@tcp: client import never connected 00000100:00080000:0.0:1783947576.865409:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783947576.865411:0:15700:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783947576.865413:0:15700:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783947576.865415:0:15700:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783947576.865442:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947576.865445:0:15700:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.103@tcp (uuid c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2) 00000020:01000000:0.0:1783947576.865451:0:15700:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783947576.865724:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc64eb800/c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2 for MGC192.168.204.103@tcp 00000020:00000080:2.0:1783947576.865731:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7bc64e8800 for MGC192.168.204.103@tcp 00000020:00000080:2.0:1783947576.865736:0:37:0:(genops.c:906:class_export_put()) final put ffff9e7bc64ea000/c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2 00000020:00000080:2.0:1783947576.865738:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7bc64ea000/c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2 for MGC192.168.204.103@tcp 00000020:01000000:2.0:1783947576.865742:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.103@tcp (c1d30083-9a0e-4ff3-87f9-9acfb5fb12e2) 00000020:00000080:0.0:1783947576.866425:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947576.866435:0:15700:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783947576.866440:0:15700:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e7ac73cf800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783947576.866445:0:15700:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9e7bf7f719c0) has exports, disconnecting them 00000020:00080000:0.0:1783947576.866450:0:15700:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e7ac73cf800), last request at 1783947355 00000020:00000080:0.0:1783947576.866486:0:15700:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb55500027 00000020:00080000:0.0:1783947576.866498:0:15700:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac73cf800): rc 0 00000020:00000080:0.0:1783947576.866501:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7ac73cf800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783947576.867853:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac73cf800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1783947576.871555:0:15700:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783947576.871565:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783947576.871581:0:15700:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783947576.871588:0:15700:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783947576.871775:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783947576.871784:0:15700:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1783947576.871792:0:15700:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783947576.871797:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783947576.871802:0:15700:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783947576.871810:0:15700:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9e7ac716c800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783947576.871816:0:15700:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9e7ac66f4d40) has exports, disconnecting them 00000020:00080000:3.0:1783947576.871820:0:15700:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9e7ac716c800), last request at 1783947355 00000020:00000080:3.0:1783947576.871835:0:15700:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb5550003c 00000020:00080000:3.0:1783947576.871850:0:15700:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e7ac716c800): rc 0 00000020:00000080:3.0:1783947576.871855:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7ac716c800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1783947576.872658:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac73ca800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783947576.872667:0:37:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783947576.872670:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783947576.872675:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783947576.872736:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac716c800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1783947576.872765:0:15700:0:(obd_class.h:673:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783947576.872768:0:15700:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783947576.872772:0:15700:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783947576.872776:0:15700:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783947576.872796:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9e7ac716b000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1783947576.872835:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1783947576.872952:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1783947576.873005:0:10390:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1783947576.873624:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1783947576.873724:0:9527:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9e7ac73d1000:9527] 2 exiting: rc = 0 00000100:00100000:2.0:1783947576.873920:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e7bd151a000:6494] 1 exiting: rc = 0 00000100:00100000:2.0:1783947576.873974:0:6493:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e7bd151be00:6493] 0 exiting: rc = 1 00000100:00100000:2.0:1783947576.874075:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.874396:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e7bd151a800:6496] 1 exiting: rc = 0 00000100:00100000:2.0:1783947576.874559:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e7bd151b400:6495] 0 exiting: rc = 1 00000100:00100000:2.0:1783947576.874851:0:7462:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e7bffb08400:7462] 3 exiting: rc = 0 00000100:00100000:2.0:1783947576.874926:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e7bd151b800:6497] 2 exiting: rc = 0 00000100:00100000:1.0:1783947576.875527:0:9516:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9e7ac5adf600:9516] 4 exiting: rc = 0 00000100:00100000:2.0:1783947576.875688:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875709:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875716:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875722:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875727:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875733:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875739:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875745:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875760:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875766:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875772:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875779:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875784:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875790:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875809:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875815:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875820:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875826:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875832:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875838:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875843:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875849:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875853:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875858:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875863:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875867:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875872:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875877:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875882:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875887:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875892:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875897:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875902:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875907:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875913:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875918:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875923:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875928:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875933:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875938:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875943:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875947:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875952:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875957:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875961:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875966:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875972:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875977:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875982:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875994:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.875999:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876005:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876009:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876014:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876020:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876541:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876547:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876553:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876559:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876564:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876577:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876583:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876588:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947576.876593:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783947576.878696:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783947576.878709:0:15700:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1783947576.878714:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7ac716f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1783947576.878719:0:15700:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac716f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1783947576.878725:0:15700:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1783947576.878792:0:15700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc47c2000 1 00000020:00000080:2.0:1783947576.878798:0:15700:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe6fd1fdb554fffcc 00000020:00000080:2.0:1783947576.878804:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7ac65c0000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783947576.878816:0:15700:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783947576.878828:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7ac65c0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783947576.878837:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783947576.878842:0:15700:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783947576.878846:0:15700:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9e7ac66f3380) has no exports 00000020:00000080:0.0:1783947577.020558:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947577.020572:0:15700:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783947577.020578:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7be7b4f000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783947577.020582:0:15700:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7b4f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783947577.020589:0:15700:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783947577.020921:0:15700:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e7be78ba000 00000020:01000000:0.0:1783947577.020951:0:15700:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783947577.020955:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783947577.020960:0:15700:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783947577.020964:0:15700:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9e7bf7f73380) has no exports 00000020:00000080:0.0:1783947577.020998:0:15700:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783947577.021004:0:15700:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783947577.021008:0:15700:0:(genops.c:906:class_export_put()) final put ffff9e7be7a27000/OSS_uuid 00000020:00000080:0.0:1783947577.021010:0:15700:0:(genops.c:865:class_export_destroy()) destroying export ffff9e7be7a27000/OSS_uuid for OSS 00000020:01000000:0.0:1783947577.021014:0:15700:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1783947577.028718:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e7be7819800:8426] 0 exiting: rc = 1 00000100:00100000:0.0:1783947577.028718:0:10351:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9e7ac7591600:10351] 4 exiting: rc = 0 00000100:00100000:1.0:1783947577.028884:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e7bffb34800:8429] 2 exiting: rc = 0 00000100:00100000:2.0:1783947577.029038:0:8539:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e7bff9f9200:8539] 3 exiting: rc = 0 00000100:00100000:2.0:1783947577.029119:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e7be78c5800:8427] 1 exiting: rc = 0 00000100:00080000:3.0:1783947577.033937:0:6506:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1783947577.036612:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036626:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036632:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036648:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036656:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036661:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036666:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036672:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036677:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036682:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036687:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036692:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036698:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036703:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036723:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036728:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036734:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036739:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036744:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036749:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036753:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036759:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036763:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036768:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036773:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036778:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036783:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036788:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036793:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036799:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036804:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036809:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036815:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036820:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036826:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036831:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036836:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036841:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036846:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036851:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036855:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036860:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036864:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036869:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036873:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036877:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036882:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036887:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036891:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036905:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036910:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036914:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036919:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036924:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036929:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036934:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036939:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036943:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036948:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036953:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036959:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036964:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036975:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.036989:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947577.037877:0:13811:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9e7ac7c2dc00:13811] 2 exiting: rc = 0 00000100:00100000:3.0:1783947577.037957:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e7be78c4400:8430] 0 exiting: rc = 1 00000100:00100000:1.0:1783947577.038108:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e7bc3693a00:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1783947577.038235:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038243:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038249:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038254:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038269:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038275:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038280:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038285:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038290:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038295:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038301:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038306:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038312:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038318:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038322:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038328:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038333:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038338:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038343:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038347:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038365:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038370:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038374:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038379:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038383:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038388:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038392:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038397:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038401:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038406:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038411:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038416:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038420:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038425:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038430:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038436:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038440:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038445:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038450:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038482:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038489:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038494:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038499:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038504:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038509:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038514:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038519:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038525:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038530:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038534:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038539:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038544:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038549:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038561:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038567:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038579:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038585:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038590:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038595:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038601:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038606:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038612:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038617:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.038623:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947577.039602:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e7bffb2a000:8433] 1 exiting: rc = 0 00000100:00100000:1.0:1783947577.039602:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e7be7980a00:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1783947577.039895:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e7bffb2a800:8434] 2 exiting: rc = 0 00000100:00100000:0.0:1783947577.039972:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.039980:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.039985:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.039992:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.039998:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040003:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040009:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040014:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040020:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040026:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040031:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040037:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040042:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040049:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040055:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040060:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040066:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040073:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040079:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040085:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040091:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040111:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040119:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040125:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040130:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040136:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040153:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040159:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040165:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040171:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040177:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040184:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040190:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040196:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040202:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040207:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040215:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040221:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040227:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040233:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040238:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040243:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040249:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040255:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040270:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040291:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040299:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040305:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040311:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040317:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040324:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040330:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040337:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040344:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040360:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040366:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040372:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040377:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040384:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040390:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040396:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040410:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040416:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.040421:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783947577.053085:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e7bffb2a600:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1783947577.053364:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e7bffb2a400:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1783947577.053526:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053535:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053541:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053546:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053554:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053613:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053620:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053625:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053630:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053635:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053640:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053645:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053651:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053656:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053661:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053666:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053670:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053676:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053681:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053697:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053703:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053708:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053714:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053719:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053724:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.053738:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055125:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055142:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055148:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055154:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055159:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055164:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055169:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055174:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055180:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055185:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055190:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055195:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055200:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055206:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055211:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055216:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055221:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055227:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055233:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055239:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055244:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055268:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055274:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055279:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055285:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055290:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055296:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055302:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055309:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055315:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055320:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055325:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055331:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055336:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055356:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055362:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055368:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783947577.055374:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783947577.059728:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e7bc2f28000:8437] 0 exiting: rc = 1 00000100:00100000:1.0:1783947577.060015:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e7ac176ba00:8438] 1 exiting: rc = 0 00000100:00100000:0.0:1783947577.060186:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060195:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060207:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060231:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060238:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060244:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060343:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060351:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060358:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060364:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060371:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060377:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060383:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060390:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060397:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060416:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060423:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060429:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060435:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060442:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060449:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060600:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060609:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060615:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060622:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060629:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060636:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060657:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060664:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060672:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060678:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060695:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060712:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060718:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060725:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060732:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060738:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060750:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060757:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060775:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060782:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060788:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060796:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060802:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060808:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060815:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060934:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060944:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060951:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060957:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060964:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060986:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060993:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.060999:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061014:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061021:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061027:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061033:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061039:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061046:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061053:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061066:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061073:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783947577.061088:0:15700:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783947577.073935:0:15700:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783947596.952119:0:16466:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783947607.719552:0:17066:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783947607.719558:0:17066:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783947607.719560:0:17066:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783947607.719679:0:17066:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7ac7ff8000 00000020:01000004:2.0:1783947607.719696:0:17066:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783947607.719704:0:17066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783947607.719718:0:17066:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e7ac66f4d40) 00000020:00000080:2.0:1783947607.719732:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783947607.773495:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783947607.773811:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.777116:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783947607.778703:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.778909:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.779298:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.779567:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.779769:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.779951:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.780142:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.781014:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.781438:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.781850:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.782083:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.782483:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.782725:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.782898:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.783122:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.783521:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.783735:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.783963:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.784326:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.784607:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.784850:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.785041:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.785352:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.785711:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.785951:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.786689:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.786929:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.787383:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.788036:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.788517:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783947607.788943:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.789297:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783947607.790376:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783947607.790816:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783947607.791024:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783947607.791689:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783947607.791894:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783947607.792095:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783947607.792579:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783947607.792838:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783947607.793109:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783947607.793585:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783947607.793811:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783947607.794011:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783947607.795979:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1783947607.796634:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1783947607.796989:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1783947607.797655:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1783947607.797919:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1783947607.798151:0:17066:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1783947607.798816:0:17066:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783947607.799034:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783947607.799042:0:17066:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783947607.799054:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501210 00000020:01000004:2.0:1783947607.799061:0:17066:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1783947607.799066:0:17066:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783947607.799072:0:17066:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7ac7ff8000 from MGS 00000020:01000004:2.0:1783947607.799076:0:17066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783947607.799086:0:17066:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e7ac66f19c0) 00000020:00000080:2.0:1783947607.799097:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783947607.799160:0:17066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7ac7ff8000 from MGS, refs=2 00080000:01000000:2.0:1783947607.799166:0:17066:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947607.799182:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb5550121e 00000100:00100000:2.0:1783947607.799272:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783947607.799393:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783947607.799400:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783947607.800364:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783947607.800375:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783947607.801367:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947607.801714:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783947607.801719:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783947607.803003:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783947607.803015:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783947607.803787:0:17066:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783947607.803795:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783947607.804986:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947607.804991:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947607.804993:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947607.805682:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947607.805685:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947607.805687:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947607.806174:0:17066:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783947607.811593:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783947607.812335:0:17066:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1783947607.820619:0:17078:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783947607.822332:0:17066:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783947607.822386:0:17066:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783947607.823347:0:17066:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783947607.823918:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947607.824071:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783947607.824077:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783947607.825109:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783947607.825117:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783947607.825902:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783947607.825911:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783947607.826994:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783947607.827018:0:17066:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.103@tcp' 00000020:01000004:3.0:1783947607.827020:0:17066:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783947607.827051:0:17066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.103@tcp (typ=mgc) 00000020:00000080:3.0:1783947607.827064:0:17066:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.103@tcp (ffff9e7ac7798000) 00000020:00000080:3.0:1783947607.827080:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783947607.827180:0:17066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bc48d4800@MGC192.168.204.103@tcp: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947607.827320:0:17066:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.103@tcp-0 is initialized 00000040:01000000:3.0:1783947607.827327:0:17066:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 1 is initialized 00000100:00080000:2.0:1783947607.830208:0:17083:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783947607.833301:0:17085:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783947607.833411:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.103@tcp (uuid c5bf4e70-0b4f-4c54-b791-4147365ffdfe) 00000020:00000080:3.0:1783947607.833438:0:17066:0:(genops.c:1406:class_connect()) connect: client c5bf4e70-0b4f-4c54-b791-4147365ffdfe, cookie 0xe6fd1fdb5550122c 00000100:00080000:3.0:1783947607.833452:0:17066:0:(import.c:510:import_select_connection()) MGC192.168.204.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947607.833484:0:17066:0:(import.c:624:import_select_connection()) MGC192.168.204.103@tcp: import ffff9e7bc48d4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947607.833522:0:17066:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c93b80 x1870604236133632/t0(0) o250->MGC192.168.204.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947607.833552:0:17066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c5bf4e70-0b4f-4c54-b791-4147365ffdfe->MGS 00000020:01000004:3.0:1783947607.833577:0:17066:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783947607.833583:0:17066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783947607.833597:0:17066:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e7ac779cd40) 00000020:00000080:3.0:1783947607.833611:0:17066:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783947607.837515:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3636:1870604236133632:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783947607.837595:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947607.844121:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236133632 00000100:00100000:3.0:1783947607.844146:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236133632 00000100:00100000:3.0:1783947607.844211:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947607.844220:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1870604236133632:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783947607.844248:0:17080:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c5bf4e70-0b4f-4c54-b791-4147365ffdfe@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:3.0:1783947607.844276:0:17080:0:(genops.c:1406:class_connect()) connect: client c5bf4e70-0b4f-4c54-b791-4147365ffdfe, cookie 0xe6fd1fdb5550123a 00000100:00080000:3.0:1783947607.844413:0:17080:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947607.844546:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+5:3636:x1870604236133632:12345-0@lo:250:mount.lustre.0 Request processed in 326us (6949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947607.844554:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947607.846964:0:3636:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783947607.846981:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.103@tcp: connect to target with instance 0 00000100:00080000:2.0:1783947607.846990:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783947607.846997:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783947607.847002:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc48d4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783947607.847006:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783947607.847022:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783947607.847043:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3636:1870604236133632:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783947607.854873:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947607.855062:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783947607.855069:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783947607.856086:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947607.856101:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783947607.857024:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783947607.857035:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783947607.857999:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783947607.858334:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783947607.858340:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783947607.860765:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783947607.860777:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783947607.917331:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947607.917621:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783947607.917629:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783947607.918626:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783947607.918635:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783947607.919198:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947607.919349:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783947607.919354:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783947607.920095:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783947607.920104:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783947607.920629:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947607.920773:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783947607.920778:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783947607.921381:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783947607.921388:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783947607.922083:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947607.922228:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783947607.922233:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783947607.922815:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783947607.922822:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783947607.943766:0:17066:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947607.943960:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783947607.943967:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783947607.946142:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783947607.946156:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783947607.946969:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783947607.946977:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783947607.947849:0:17066:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783947607.947876:0:17066:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1783947607.947883:0:17066:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783947607.947993:0:17066:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783947607.948032:0:17066:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783947607.948037:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783947607.948041:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947607.948042:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947607.948044:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947607.948045:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947607.948046:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947607.948047:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947607.948049:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947607.948051:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947607.948052:0:17066:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947607.948054:0:17066:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783947607.948056:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947607.948057:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947607.948058:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947607.948059:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947607.948061:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947607.948062:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947607.948063:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947607.948064:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947607.948065:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947607.948066:0:17066:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783947607.948088:0:17066:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783947607.948107:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236133760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783947607.948177:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947607.948238:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd093a540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947607.948741:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236133760 00000100:00100000:2.0:1783947607.948748:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236133760 00000100:00100000:2.0:1783947607.948796:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947607.948806:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+5:17066:x1870604236133760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783947607.948858:0:17082:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783947607.948861:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783947607.948864:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783947607.949872:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783947607.950680:0:17082:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1783947607.953026:0:17104:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783947607.953033:0:17104:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1783947607.953037:0:17104:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783947607.953039:0:17104:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783947607.953506:0:17104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1783947607.953872:0:17082:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783947607.953883:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783947607.958878:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+5:17066:x1870604236133760:12345-0@lo:253:mount.lustre.0 Request processed in 10063us (10690us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947607.958894:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947607.958989:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236133760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783947607.959006:0:17066:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783947607.959009:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947607.959011:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947607.959012:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947607.959013:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947607.959015:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947607.959016:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947607.959017:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947607.959018:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947607.959020:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947607.959022:0:17066:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783947607.959043:0:17066:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7ac7ff8000 from lustre-MDT0000 10000000:01000000:1.0:1783947607.959077:0:17066:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783947607.959094:0:17066:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783947607.959099:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e7ac7798000 10000000:01000000:1.0:1783947607.959832:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947607.959846:0:17066:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9e7ac7798000 from 1 10000000:01000000:1.0:1783947607.959849:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783947607.959888:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.959900:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.959910:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947607.959932:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236133888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947607.959983:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947607.960081:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd093a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947607.960687:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236133888 00000100:00100000:0.0:1783947607.960696:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236133888 00000100:00100000:0.0:1783947607.960792:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947607.960801:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+5:17066:x1870604236133888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947607.960816:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947607.960832:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb55501248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501241 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.960855:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb55501248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501241 expref: 6 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.960865:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9a000/0xe6fd1fdb55501248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501241 expref: 6 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.960874:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a000, rc 0) 00000100:00100000:0.0:1783947607.960926:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+6:17066:x1870604236133888:12345-0@lo:101:mount.lustre.0 Request processed in 127us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947607.960933:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947607.961008:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236133888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947607.961024:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.961034:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947607.961094:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947607.961121:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947607.961832:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd093a240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947607.961975:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236134016 00000100:00100000:3.0:1783947607.961980:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236134016 00000100:00100000:3.0:1783947607.962009:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783947607.962016:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+6:17066:x1870604236134016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947607.962263:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+6:17066:x1870604236134016:12345-0@lo:501:mount.lustre.0 Request processed in 246us (1140us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783947607.962270:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947607.962836:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134016:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783947607.962883:0:17066:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783947607.962960:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.962970:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947607.962980:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7ac7ff8000 10000000:01000000:1.0:1783947607.962985:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783947607.962990:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e7ac7ff8000 10000000:01000000:1.0:1783947607.962993:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783947607.962996:0:17066:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e7ac7ff8000 from 1 10000000:01000000:1.0:1783947607.962998:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783947607.963026:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.963035:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.963045:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947607.963064:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947607.963103:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947607.963137:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd093a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947607.963412:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236134144 00000100:00100000:0.0:1783947607.963425:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236134144 00000100:00100000:0.0:1783947607.963477:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947607.963485:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+6:17066:x1870604236134144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947607.963498:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947607.963513:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb55501256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550124f expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.963536:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb55501256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550124f expref: 7 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.963547:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9ac00/0xe6fd1fdb55501256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550124f expref: 7 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.963556:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9ac00, rc 0) 00000100:00100000:0.0:1783947607.963598:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+7:17066:x1870604236134144:12345-0@lo:101:mount.lustre.0 Request processed in 114us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947607.963604:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947607.963782:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947607.963795:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.963803:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947607.963825:0:17066:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783947607.964703:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.964715:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55200/0xe6fd1fdb5550124f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501256 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947607.964724:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783947607.964730:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947607.964736:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e7ac7ff8000 10000000:01000000:1.0:1783947607.964739:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783947607.964742:0:17066:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783947607.964745:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783947607.964770:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.964777:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947607.964785:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947607.964803:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947607.964850:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947607.964884:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd093a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947607.965098:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236134272 00000100:00100000:0.0:1783947607.965105:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236134272 00000100:00100000:0.0:1783947607.965156:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947607.965165:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+7:17066:x1870604236134272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947607.965184:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947607.965686:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9be00/0xe6fd1fdb55501264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550125d expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.965713:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9be00/0xe6fd1fdb55501264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550125d expref: 8 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.965724:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9be00/0xe6fd1fdb55501264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550125d expref: 8 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947607.965745:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9be00, rc 0) 00000100:00100000:0.0:1783947607.965798:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+8:17066:x1870604236134272:12345-0@lo:101:mount.lustre.0 Request processed in 634us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947607.965806:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947607.965897:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947607.965913:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947607.965921:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947607.966045:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947607.966074:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947607.966107:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc4c2fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947607.966167:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236134400 00000100:00100000:0.0:1783947607.966180:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236134400 00000100:00100000:0.0:1783947607.966566:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947607.966576:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+8:17066:x1870604236134400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947607.966746:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17066:x1870604236134400:12345-0@lo:501:mount.lustre.0 Request processed in 172us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947607.966753:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947607.966829:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947607.966864:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947607.966909:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947607.966937:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc4c2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947607.967005:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236134528 00000100:00100000:1.0:1783947607.967009:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236134528 00000100:00100000:1.0:1783947607.967047:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947607.967061:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17066:x1870604236134528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947607.973509:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17066:x1870604236134528:12345-0@lo:503:mount.lustre.0 Request processed in 6439us (6589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947607.973524:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783947607.973686:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236134528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947607.975941:0:17105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17105:1870604236134656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947607.976024:0:17105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947607.976074:0:17105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc4c2ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947607.976130:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236134656 00000100:00100000:3.0:1783947607.976138:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236134656 00000100:00100000:3.0:1783947607.976217:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783947607.976226:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17105:x1870604236134656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947607.978053:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17105:x1870604236134656:12345-0@lo:502:llog_process_th.0 Request processed in 1821us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947607.978066:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947607.978191:0:17105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17105:1870604236134656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947607.978585:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947607.978598:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947607.978600:0:17105:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783947607.978607:0:17105:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783947607.978610:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947607.978628:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e7ac66f3380) 00000020:00000080:2.0:1783947607.978647:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783947607.978653:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783947607.978765:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783947607.978773:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501272 00000020:00000080:2.0:1783947607.978979:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783947607.978983:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947607.978987:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947607.978988:0:17105:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783947607.978991:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947607.978995:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947607.978996:0:17105:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783947607.979000:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947607.979007:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e7ac66f0000) 00000020:00000080:2.0:1783947607.979016:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783947607.979020:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783947607.979022:0:17105:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783947607.979024:0:17105:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783947607.979029:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947607.979074:0:17105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7ac7ff8000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783947607.979095:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e7bc5510000) 00000020:00000080:2.0:1783947607.979104:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783947607.979181:0:17105:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783947607.979188:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501287 00000020:00000080:2.0:1783947607.979712:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783947607.979719:0:17105:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783947607.979724:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe6fd1fdb5550128e 00080000:01000000:2.0:1783947607.979730:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783947607.979733:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb55501295 00010000:00010000:1.0:1783947608.096758:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1783947608.101878:0:17105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1783947608.102881:0:17105:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783947608.103731:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e7c01b88000) 00000020:00000080:0.0:1783947608.103751:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783947608.103833:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783947608.103840:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb555012a3 00000020:00000080:0.0:1783947608.114535:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783947608.124798:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe6fd1fdb555012aa 00000020:00000080:1.0:1783947608.126766:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783947608.126782:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947608.126791:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.126793:0:17105:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783947608.126796:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783947608.126799:0:17105:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1783947608.126801:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783947608.126802:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783947608.126804:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783947608.126806:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.126807:0:17105:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783947608.126809:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947608.126813:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.126814:0:17105:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783947608.126819:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783947608.126869:0:17105:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783947608.126890:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947608.126893:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.126894:0:17105:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783947608.126896:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947608.126899:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.126901:0:17105:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783947608.126903:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783947608.126908:0:17105:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:1.0:1783947608.126937:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947608.126954:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9e7bf3fb4d40) 00000020:00000080:1.0:1783947608.126972:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783947608.126976:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783947608.127031:0:17105:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783947608.127036:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783947608.127054:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb555012b8 00010000:00080000:1.0:1783947608.127089:0:17105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7c003f9000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947608.141550:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1783947608.147974:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947608.147989:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783947608.148032:0:17105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783947608.148054:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb555012bf 00000100:00080000:0.0:1783947608.148064:0:17105:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947608.148082:0:17105:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7c003f9000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947608.148118:0:17105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e2d80 x1870604236134784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947608.148966:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236134784:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783947608.149046:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947608.149181:0:17105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1783947608.149834:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947608.149840:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.149843:0:17105:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783947608.149847:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783947608.149850:0:17105:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1783947608.149852:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947608.149853:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783947608.149855:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783947608.149857:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.149858:0:17105:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783947608.149861:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783947608.149865:0:17105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783947608.149869:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.149870:0:17105:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783947608.149873:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783947608.149877:0:17105:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:0.0:1783947608.149898:0:17105:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783947608.149901:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783947608.149915:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e7c01b8cd40) 00000020:00000080:0.0:1783947608.149935:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783947608.149941:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783947608.150038:0:17105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783947608.150045:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783947608.150053:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb555012cd 00010000:00080000:0.0:1783947608.150095:0:17105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bd10ba800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.103@tcp at head 00000100:00100000:3.0:1783947608.151720:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236134784 00000100:00100000:3.0:1783947608.151734:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236134784 00000100:00100000:3.0:1783947608.151772:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947608.151780:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236134784:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1783947608.151801:0:17092:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:0.0:1783947608.153994:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1783947608.156682:0:17105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783947608.157277:0:17105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783947608.163866:0:17105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947608.164075:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1783947608.164218:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1783947608.166432:0:17111:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783947608.166439:0:17111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783947608.167326:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783947608.167338:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783947608.167373:0:17105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783947608.167581:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb555012d4 00000100:00080000:1.0:1783947608.167594:0:17105:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947608.167600:0:17105:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bd10ba800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947608.167638:0:17105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d6b480 x1870604236134912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947608.167715:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236134912:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783947608.167776:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236134912 offset 0 length 520: 4 00000100:00080000:1.0:1783947608.167835:0:17105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783947608.167899:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947608.167903:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.167905:0:17105:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783947608.167908:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783947608.167911:0:17105:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1783947608.167913:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783947608.167914:0:17105:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783947608.167916:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783947608.167918:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.167920:0:17105:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783947608.167922:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783947608.167934:0:17105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783947608.167938:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947608.167939:0:17105:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783947608.167943:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783947608.167957:0:17105:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:1.0:1783947608.167979:0:17105:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783947608.167982:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783947608.167995:0:17105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e7bf3fb19c0) 00000020:00000080:1.0:1783947608.168009:0:17105:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1783947608.168014:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783947608.168072:0:17105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783947608.168079:0:17105:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783947608.168085:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe6fd1fdb555012e2 00010000:00080000:1.0:1783947608.168114:0:17105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bc47c4800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947608.168307:0:17105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1783947608.168373:0:17105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783947608.168657:0:17105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783947608.177170:0:17105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947608.178072:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1783947608.179168:0:17105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1783947608.184288:0:17113:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783947608.184297:0:17113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783947608.189646:0:17105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783947608.189675:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783947608.190012:0:17105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783947608.190036:0:17105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb555012e9 00000100:00080000:0.0:1783947608.190047:0:17105:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947608.190053:0:17105:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7bc47c4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947608.190091:0:17105:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e3b80 x1870604236135040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947608.190509:0:17105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1783947608.190595:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947608.190600:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.190602:0:17105:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783947608.190605:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947608.190609:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.190610:0:17105:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783947608.190613:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783947608.190616:0:17105:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783947608.190618:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947608.190620:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.190622:0:17105:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783947608.190624:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783947608.190627:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.190628:0:17105:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783947608.190631:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783947608.190681:0:17105:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17105:1870604236135168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947608.191205:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236135040:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783947608.191261:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236135040 offset 0 length 520: 4 00000100:00100000:0.0:1783947608.193815:0:17105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947608.193857:0:17105:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7a50e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.193990:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236135168 00000100:00100000:1.0:1783947608.194000:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236135168 00000100:00100000:1.0:1783947608.194049:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947608.194058:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17105:x1870604236135168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.194223:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17105:x1870604236135168:12345-0@lo:502:llog_process_th.0 Request processed in 165us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.194231:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947608.194263:0:17105:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17105:1870604236135168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783947608.194295:0:17105:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783947608.194309:0:17105:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783947608.194311:0:17105:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783947608.194316:0:17105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1783947608.194428:0:17066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1783947608.194452:0:17066:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783947608.194485:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.194505:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54800/0xe6fd1fdb5550125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501264 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947608.194513:0:17066:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7ac7ff8000 from 1 10000000:01000000:1.0:1783947608.194516:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947608.194550:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.194558:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.194567:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947608.194588:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947608.194622:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.194638:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947608.194818:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236135296 00000100:00100000:2.0:1783947608.194823:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236135296 00000100:00100000:2.0:1783947608.194856:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947608.194863:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+9:17066:x1870604236135296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947608.194873:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947608.194888:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555012f0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947608.194908:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947608.194918:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947608.194949:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b800, rc 0) 00000100:00100000:2.0:1783947608.194979:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+10:17066:x1870604236135296:12345-0@lo:101:mount.lustre.0 Request processed in 117us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947608.194986:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947608.195084:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947608.195097:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.195105:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947608.195689:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135424:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783947608.195729:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.195756:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947608.195815:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236135424 00000100:00100000:2.0:1783947608.195820:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236135424 00000100:00100000:2.0:1783947608.195853:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947608.195860:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+10:17066:x1870604236135424:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783947608.195876:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783947608.195882:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783947608.195970:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+10:17066:x1870604236135424:12345-0@lo:256:mount.lustre.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947608.195977:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783947608.196503:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135424:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783947608.198880:0:17066:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783947608.198901:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947608.198915:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947608.198923:0:17066:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7ac7ff8000 from 1 10000000:01000000:0.0:1783947608.198926:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:2.0:1783947608.199123:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236134784:12345-0@lo:38:llog_process_th.0 Request processed in 47339us (50072us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947608.199138:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783947608.199262:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947608.199268:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783947608.199272:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236134784:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1783947608.199551:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.199562:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.199573:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947608.199593:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947608.199635:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.199679:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947608.199804:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236135552 00000100:00100000:0.0:1783947608.199810:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236135552 00000100:00100000:0.0:1783947608.199858:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783947608.199867:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+10:17066:x1870604236135552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947608.199881:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947608.199895:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555012fe expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947608.199916:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947608.200280:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 11 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947608.200294:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:0.0:1783947608.200346:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17066:x1870604236135552:12345-0@lo:101:mount.lustre.0 Request processed in 479us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947608.200366:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783947608.200569:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947608.200587:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.200597:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947608.200680:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947608.200709:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.200742:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190840 going to sleep for 11 seconds 00000100:00100000:2.0:1783947608.200800:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236135680 00000100:00100000:2.0:1783947608.200805:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236135680 00000100:00100000:2.0:1783947608.201077:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947608.201085:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17066:x1870604236135680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947608.202314:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17066:x1870604236135680:12345-0@lo:501:mount.lustre.0 Request processed in 1224us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947608.202343:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947608.204577:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947608.204656:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947608.204898:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.205279:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947608.205405:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236135808 00000100:00100000:0.0:1783947608.205412:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236135808 00000100:00100000:0.0:1783947608.205497:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947608.205610:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17066:x1870604236135808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947608.205787:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17066:x1870604236135808:12345-0@lo:503:mount.lustre.0 Request processed in 233us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947608.205853:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236135808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947608.206693:0:17115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17115:1870604236135936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947608.206746:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947608.206780:0:17115:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947608.206876:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236135936 00000100:00100000:0.0:1783947608.206882:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236135936 00000100:00100000:1.0:1783947608.216834:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947608.217602:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947608.217622:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17115:x1870604236135936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783947608.218230:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17115:x1870604236135936:12345-0@lo:502:llog_process_th.0 Request processed in 613us (11480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947608.218239:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947608.218495:0:17115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17115:1870604236135936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783947608.218531:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947608.218542:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947608.218544:0:17115:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783947608.218552:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7ac7ff8000 00000020:00000080:3.0:1783947608.218555:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947608.218563:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947608.218565:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947608.218566:0:17115:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783947608.218569:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947608.218572:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947608.218573:0:17115:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783947608.218576:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7ac7ff8000 00000020:00000080:3.0:1783947608.218579:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947608.218640:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947608.218651:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947608.218652:0:17115:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783947608.218655:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947608.218671:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947608.218673:0:17115:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947608.218677:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7ac7ff8000 00000020:00000080:3.0:1783947608.218679:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947608.218699:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947608.218702:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947608.218703:0:17115:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947608.218705:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947608.218708:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947608.218709:0:17115:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783947608.218712:0:17115:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7ac7ff8000 00000020:00000080:3.0:1783947608.218714:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783947608.218851:0:17115:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17115:1870604236136064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783947608.218902:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947608.219157:0:17115:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.226090:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136064 00000100:00100000:1.0:1783947608.226162:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136064 00000100:00100000:1.0:1783947608.226886:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783947608.226899:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17115:x1870604236136064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.227242:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17115:x1870604236136064:12345-0@lo:502:llog_process_th.0 Request processed in 346us (8338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.227250:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783947608.229103:0:17115:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17115:1870604236136064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783947608.229160:0:17115:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947608.229170:0:17115:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947608.229173:0:17115:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783947608.229177:0:17115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783947608.229517:0:17066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783947608.229546:0:17066:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947608.229568:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947608.229581:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947608.229642:0:17066:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783947608.229646:0:17066:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7ac7ff8000 10000000:01000000:0.0:1783947608.229649:0:17066:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7ac7ff8000 10000000:01000000:0.0:1783947608.229653:0:17066:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947608.229670:0:17066:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7ac7ff8000 from 1 10000000:01000000:0.0:1783947608.229673:0:17066:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947608.229707:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947608.229715:0:17066:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947608.229863:0:17066:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947608.229889:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236136192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947608.230094:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947608.232132:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.238095:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136192 00000100:00100000:1.0:1783947608.238110:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136192 00000100:00100000:1.0:1783947608.238187:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947608.238198:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17066:x1870604236136192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947608.238216:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947608.238237:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d54600/0xe6fd1fdb55501313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550130c expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.238264:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d54600/0xe6fd1fdb55501313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550130c expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.238287:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d54600/0xe6fd1fdb55501313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550130c expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.238296:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54600, rc 0) 00000100:00100000:1.0:1783947608.238393:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17066:x1870604236136192:12345-0@lo:101:mount.lustre.0 Request processed in 197us (8298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.238413:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947608.238529:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236136192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947608.238548:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.238557:0:17066:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947608.238739:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236136320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947608.239083:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.239112:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.239127:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136320 00000100:00100000:1.0:1783947608.239130:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136320 00000100:00100000:1.0:1783947608.239146:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947608.239150:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17066:x1870604236136320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947608.239666:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17066:x1870604236136320:12345-0@lo:501:mount.lustre.0 Request processed in 504us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.239676:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783947608.239721:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236136320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947608.239755:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236136448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947608.239904:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.239925:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.239939:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136448 00000100:00100000:1.0:1783947608.239944:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136448 00000100:00100000:1.0:1783947608.239966:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947608.240050:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17066:x1870604236136448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947608.240130:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17066:x1870604236136448:12345-0@lo:503:mount.lustre.0 Request processed in 151us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.240137:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783947608.240174:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236136448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947608.243307:0:17119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17119:1870604236136576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.243389:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.243427:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136576 00000100:00100000:1.0:1783947608.243433:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136576 00000100:00100000:1.0:1783947608.243491:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947608.243500:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17119:x1870604236136576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.243627:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17119:x1870604236136576:12345-0@lo:502:llog_process_th.0 Request processed in 127us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.243635:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947608.243700:0:17119:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.244832:0:17119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17119:1870604236136576:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783947608.244911:0:17119:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783947608.244930:0:17119:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e7bf3fb3380) 00000020:00000080:1.0:1783947608.244953:0:17119:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783947608.245222:0:17119:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7ac7ff8000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783947608.245227:0:17119:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7ac7ff8000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783947608.245230:0:17119:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7ff8000 4 00010000:00080000:1.0:1783947608.245260:0:17119:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7c01bf0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947608.250026:0:17119:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1783947608.251878:0:17119:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783947608.251927:0:17119:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783947608.251949:0:17119:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe6fd1fdb55501321 00000100:00080000:1.0:1783947608.251960:0:17119:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947608.251967:0:17119:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e7c01bf0000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947608.252007:0:17119:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d69180 x1870604236136704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947608.252039:0:17119:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783947608.252324:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236136704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947608.252637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947608.252859:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136704 00000100:00100000:3.0:1783947608.252867:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136704 00000100:00100000:3.0:1783947608.252904:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783947608.252911:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236136704:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783947608.252976:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1870604236136704:12345-0@lo:38:llog_process_th.0 Request processed in 62us (337us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783947608.252983:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947608.253305:0:17119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17119:1870604236136832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.253353:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.253375:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136832 00000100:00100000:1.0:1783947608.253378:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136832 00000100:00100000:1.0:1783947608.253415:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947608.253421:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17119:x1870604236136832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.253558:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17119:x1870604236136832:12345-0@lo:502:llog_process_th.0 Request processed in 136us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.253566:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947608.253602:0:17119:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.253623:0:17119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17119:1870604236136832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.253671:0:17119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17119:1870604236136960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783947608.253699:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.253711:0:17119:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947608.254215:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236136960 00000100:00100000:3.0:1783947608.254222:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236136960 00000100:00100000:3.0:1783947608.254256:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947608.254264:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17119:x1870604236136960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783947608.254502:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947608.254510:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947608.254515:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783947608.254519:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236136704:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783947608.255246:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17119:x1870604236136960:12345-0@lo:502:llog_process_th.0 Request processed in 980us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947608.255264:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783947608.255328:0:17119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17119:1870604236136960:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783947608.255352:0:17119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783947608.259060:0:17066:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1783947608.259095:0:17066:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783947608.259182:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.259195:0:17066:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9aa00/0xe6fd1fdb5550130c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501313 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783947608.259252:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783947608.259254:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947608.259255:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947608.259256:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947608.259258:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947608.259259:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947608.259260:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947608.259262:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947608.259264:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947608.259265:0:17066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783947608.259269:0:17066:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783947608.259271:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783947608.259273:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783947608.259274:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947608.259275:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947608.259276:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947608.259277:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947608.259278:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783947608.259279:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783947608.259280:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947608.259281:0:17066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783947608.259306:0:17066:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783947608.259327:0:17066:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236137088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783947608.259394:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947608.259420:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137088 00000100:00100000:2.0:1783947608.259428:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137088 00000100:00100000:1.0:1783947608.259431:0:17066:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd01900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947608.259487:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947608.259496:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17066:x1870604236137088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783947608.259526:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783947608.259540:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783947608.277678:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783947608.277694:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783947608.277871:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783947608.277877:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783947608.277901:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947608.277920:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947608.277929:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947608.277968:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947608.277983:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 12 pid: 17082 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947608.278009:0:17103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236137216:0@lo:104: 00000100:00100000:3.0:1783947608.278073:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947608.278215:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137216 00000100:00100000:0.0:1783947608.278222:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137216 00000100:00100000:0.0:1783947608.278262:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947608.278269:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236137216:12345-0@lo:104: 00010000:00010000:0.0:1783947608.278281:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947608.278350:0:17103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5f300 going to sleep for 11 seconds 00000100:00100000:3.0:1783947608.278369:0:17103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236137216:0@lo:104: 00010000:00010000:3.0:1783947608.278388:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947608.279173:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17066:x1870604236137088:12345-0@lo:253:mount.lustre.0 Request processed in 19673us (19774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947608.279184:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783947608.279332:0:17066:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17066:1870604236137088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783947608.279358:0:17066:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783947608.279362:0:17066:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783947608.279364:0:17066:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783947608.279365:0:17066:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783947608.279366:0:17066:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783947608.279368:0:17066:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783947608.279369:0:17066:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783947608.279370:0:17066:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783947608.279372:0:17066:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783947608.279374:0:17066:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783947608.279375:0:17066:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783947608.279390:0:17066:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783947608.285267:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783947608.285285:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236137216:12345-0@lo:104: Request processed in 7011us (7207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947608.285298:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783947608.285374:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947608.285383:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.285394:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947608.285398:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.285409:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947608.285424:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947608.285430:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947608.288970:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.288988:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947608.289015:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289023:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55c00/0xe6fd1fdb555012f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555012f7 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289044:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947608.289046:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947608.289048:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947608.289112:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236137344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947608.289250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947608.289652:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137344 00000100:00100000:1.0:1783947608.289703:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137344 00010000:00010000:1.0:1783947608.289815:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 12 pid: 17082 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947608.289848:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947608.289857:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:3637:x1870604236137344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947608.289870:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947608.289876:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 12 pid: 17082 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289899:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 12 pid: 17082 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289916:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846b800/0xe6fd1fdb555012f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555012f0 expref: 12 pid: 17082 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289933:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289941:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783947608.289956:0:17072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012079822s 00010000:00010000:1.0:1783947608.289961:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289968:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289975:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289981:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289987:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947608.289990:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.289998:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.290022:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.290032:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947608.290076:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:3637:x1870604236137344:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.290083:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783947608.290114:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.290123:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.290129:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e50000/0xe6fd1fdb55501328 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947608.291914:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236137344:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1783947608.312106:0:17066:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783947608.312649:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1783947608.313344:0:17128:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783947608.313651:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783947608.314242:0:17128:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1783947608.315277:0:17129:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9e7bf7d6aa00 x1870604236137472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947608.315292:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00000040:01000000:2.0:1783947608.315707:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783947608.316187:0:17066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783947608.317283:0:17066:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783947608.317310:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783947608.317362:0:17066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1783947608.320958:0:17127:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1783947608.320967:0:17127:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1783947608.321784:0:17066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783947608.322774:0:17066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783947608.322822:0:17066:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783947608.323078:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783947608.323224:0:17128:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:1.0:1783947608.324714:0:17066:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1783947608.326524:0:17066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783947608.328539:0:17066:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783947608.328580:0:17066:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb794815ff988 00100000:10000000:1.0:1783947608.328589:0:17066:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783947608.330419:0:17066:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783947608.330440:0:17066:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783947608.330501:0:17066:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783947608.330517:0:17066:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783947608.335116:0:17066:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947608.339898:0:17066:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783947608.824642:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783947608.886738:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947608.886746:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7ac7ff8000 from 7 10000000:01000000:3.0:1783947608.886750:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947608.886809:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947608.886821:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947608.886832:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947608.886859:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236137600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947608.886942:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947608.887023:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657d000 going to sleep for 11 seconds 00000100:00100000:1.0:1783947608.887103:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137600 00000100:00100000:1.0:1783947608.887112:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137600 00000100:00100000:1.0:1783947608.887174:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783947608.887184:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+11:17085:x1870604236137600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947608.887199:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947608.887212:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550132f expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.887235:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.887246:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.887344:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55e00, rc 0) 00000100:00100000:1.0:1783947608.887391:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17085:x1870604236137600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947608.887398:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947608.887515:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236137600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947608.887530:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947608.887780:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947608.887842:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236137728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783947608.887876:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947608.887915:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783947608.887970:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137728 00000100:00100000:0.0:1783947608.887976:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137728 00000100:00100000:0.0:1783947608.888013:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783947608.888022:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17085:x1870604236137728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783947608.888039:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783947608.888054:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783947608.888058:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783947608.888157:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17085:x1870604236137728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947608.888170:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947608.888270:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236137728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783947608.888318:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947608.888325:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947608.888335:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947609.269228:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783947609.333561:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:1.0:1783947609.845662:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947610.293998:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947610.359632:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:0.0:1783947610.872117:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947611.390082:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:1.0:1783947611.894742:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947612.404285:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00000001:02000400:1.0:1783947612.852425:0:17372:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783947612.919562:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947613.428830:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00000100:00080000:3.0:1783947613.430081:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783947613.430088:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783947613.430093:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783947613.430163:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236137856:0@lo:400:kworker.0 00000100:00100000:2.0:1783947613.430262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947613.430333:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:3.0:1783947613.430341:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783947613.430351:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7c003f9000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947613.430356:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137856 00000100:00100000:2.0:1783947613.430367:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137856 00000100:00100000:3.0:1783947613.430384:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c91f80 x1870604236137984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947613.430406:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947613.430410:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947613.430414:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947613.430417:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947613.430420:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:2.0:1783947613.430432:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1783947613.430435:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783947613.430438:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1783947613.430445:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:3638:x1870604236137856:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783947613.430476:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e7c01bf0000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947613.430493:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c92a00 x1870604236138112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783947613.430536:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236137984:0@lo:38:kworker.0 00000100:00100000:2.0:1783947613.430554:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:3638:x1870604236137856:12345-0@lo:400:kworker.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947613.430572:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947613.430759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947613.430838:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236138112:0@lo:38:kworker.0 00000100:00100000:3.0:1783947613.430896:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947613.430995:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236138112 00000100:00100000:3.0:1783947613.431004:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236138112 00000100:00100000:1.0:1783947613.431033:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236137856:0@lo:400:kworker.0 00000100:00100000:3.0:1783947613.431044:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947613.431054:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236138112:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783947613.431081:0:17089:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000100:00100000:2.0:1783947613.431212:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137984 00000100:00100000:2.0:1783947613.431219:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137984 00000100:00100000:2.0:1783947613.431246:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947613.431251:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236137984:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783947613.431267:0:17093:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:3.0:1783947613.431637:0:17089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe6fd1fdb5550133d 00000004:00100000:3.0:1783947613.431656:0:17089:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947613.431782:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9e7bff958800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947613.431861:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1870604236138112:12345-0@lo:38:kworker.0 Request processed in 806us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947613.431877:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783947613.432495:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7ac7c92a00 x1870604236138112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783947613.432519:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783947613.432530:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783947613.432536:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783947613.432540:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783947613.432549:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1870604236138112:0@lo:38:kworker.0 00000100:00100000:2.0:1783947613.448858:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236137984:12345-0@lo:38:kworker.0 Request processed in 17597us (18098us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947613.448876:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783947613.448928:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947613.448942:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783947613.448948:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236137984:0@lo:38:kworker.0 00010000:00010000:1.0:1783947613.949108:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783947613.972241:0:17424:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947613.972929:0:17424:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783947614.452531:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00000020:00000004:1.0:1783947614.828865:0:17474:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947614.829056:0:17474:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783947614.964145:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947615.477627:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:1.0:1783947615.991787:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947616.499554:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:0.0:1783947617.013644:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947617.525771:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:0.0:1783947618.038009:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947618.549319:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947608/real 1783947608] req@ffff9e7ac76e3b80 x1870604236135040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947618.549360:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac76e3b80 x1870604236135040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947618.549387:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947608/real 1783947608] req@ffff9e7bf7d6b480 x1870604236134912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947618 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947618.549401:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7bf7d6b480 x1870604236134912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947618 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783947618.549425:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947618.549450:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783947618.549479:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236135040:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783947618.549487:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947618.549493:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783947618.549496:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236134912:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783947618.549739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783947618.549745:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783947618.549748:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947618.549754:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1783947618.549760:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947618.549768:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7c003f9000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947618.549792:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e0e00 x1870604236138368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947618.549804:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947618.549807:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783947618.549808:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947618.549811:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1783947618.549815:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783947618.549818:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bd10ba800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947618.549829:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e3480 x1870604236138496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947618.549849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947618.549851:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783947618.549853:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947618.549856:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1783947618.549859:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783947618.549864:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7bc47c4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947618.549877:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e1f80 x1870604236138624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947618.552859:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00000100:00100000:2.0:1783947618.552935:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236138240:0@lo:400:kworker.0 00000100:00100000:2.0:1783947618.553036:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947618.553109:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947618.553116:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236138752:0@lo:400:kworker.0 00000100:00100000:2.0:1783947618.553148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947618.553219:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236138240 00000100:00100000:2.0:1783947618.553228:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236138240 00000100:00100000:2.0:1783947618.553285:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947618.553295:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:3639:x1870604236138240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947618.553362:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:3639:x1870604236138240:12345-0@lo:400:kworker.0 Request processed in 68us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947618.553370:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947618.553453:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236138752 00000100:00100000:2.0:1783947618.553492:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236138752 00000100:00100000:2.0:1783947618.553524:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947618.553530:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236138752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947618.553567:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236138752:12345-0@lo:400:kworker.0 Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947618.553573:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947618.553603:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236138368:0@lo:38:kworker.0 00000100:00100000:2.0:1783947618.553635:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947618.553657:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236138496:0@lo:8:kworker.0 00000400:00000100:2.0:1783947618.553677:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236138496 offset 0 length 520: 4 00000100:00100000:2.0:1783947618.553696:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236138624:0@lo:8:kworker.0 00000400:00000100:2.0:1783947618.553712:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236138624 offset 0 length 520: 4 00000100:00100000:2.0:1783947618.553737:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236138368 00000100:00100000:2.0:1783947618.553741:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236138368 00000100:00100000:2.0:1783947618.557144:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947618.557159:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236138368:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783947618.557183:0:17092:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1783947618.560942:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7ac76e2680 x1870604236138752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947618.561054:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236138752:0@lo:400:kworker.0 00000100:00100000:3.0:1783947618.561072:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236138240:0@lo:400:kworker.0 00000100:00100000:2.0:1783947618.587046:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236138368:12345-0@lo:38:kworker.0 Request processed in 29874us (33396us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783947618.587064:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783947618.589617:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947618.589636:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783947618.589643:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236138368:0@lo:38:kworker.0 00010000:00010000:0.0:1783947619.059739:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947619.571864:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:0.0:1783947620.088577:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947620.532438:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947620.595608:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:3.0:1783947621.112348:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947621.619538:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:1.0:1783947622.133073:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783947622.173807:0:17819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783947622.173811:0:17819:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783947622.173813:0:17819:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783947622.174122:0:17819:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7bff95d000 00000020:01000004:3.0:1783947622.174138:0:17819:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1783947622.174150:0:17819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783947622.174164:0:17819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9e7ac77999c0) 00000020:00000080:3.0:1783947622.174181:0:17819:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783947622.234491:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1783947622.236431:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783947622.237168:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783947622.237573:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783947622.238131:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783947622.238753:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783947622.239543:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783947622.239740:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1783947622.240538:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783947622.240806:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783947622.241369:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783947622.241631:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1783947622.241822:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1783947622.242589:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783947622.243834:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1783947622.244449:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1783947622.249705:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783947622.250414:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783947622.251186:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783947622.251576:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1783947622.251804:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783947622.252427:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.253428:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783947622.256129:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.257374:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1783947622.257776:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.259303:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1783947622.260226:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.260584:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783947622.260828:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783947622.261556:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1783947622.261814:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.262164:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.262544:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.262974:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.263490:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.263731:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.264156:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783947622.266502:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783947622.267206:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783947622.273719:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783947622.274276:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1783947622.274622:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783947622.275009:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783947622.275491:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1783947622.275749:0:17819:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00080000:01000000:1.0:1783947622.290867:0:17819:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783947622.292619:0:17819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1783947622.292649:0:17819:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783947622.292664:0:17819:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb5550134b 00000020:01000004:1.0:1783947622.292672:0:17819:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783947622.292696:0:17819:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783947622.292699:0:17819:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783947622.292705:0:17819:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1783947622.292732:0:17819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1783947622.292736:0:17819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1783947622.307514:0:17819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783947622.307568:0:17819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1783947622.307573:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783947622.307575:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947622.307576:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947622.307578:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947622.307579:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947622.307581:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947622.307582:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947622.307584:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947622.307585:0:17819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783947622.307594:0:17819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1783947622.307596:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947622.307598:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947622.307599:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947622.307600:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947622.307600:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947622.307602:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947622.307602:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947622.307603:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947622.307604:0:17819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783947622.307632:0:17819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783947622.307652:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236138880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783947622.307725:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.307770:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b000 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.307859:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236138880 00000100:00100000:2.0:1783947622.307865:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236138880 00000100:00100000:2.0:1783947622.307931:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947622.307940:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17819:x1870604236138880:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783947622.307980:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783947622.307983:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1783947622.307990:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1783947622.308655:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17819:x1870604236138880:12345-0@lo:253:mount.lustre.0 Request processed in 712us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.308665:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947622.308778:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236138880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783947622.308788:0:17819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783947622.308790:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947622.308792:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783947622.308793:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947622.308794:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947622.308795:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947622.308796:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947622.308797:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783947622.308799:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947622.308800:0:17819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783947622.308819:0:17819:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7bff95d000 from lustre-MDT0001 10000000:01000000:0.0:1783947622.308858:0:17819:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1783947622.308860:0:17819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783947622.308867:0:17819:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7ac7798000 local copy 00010000:00010000:0.0:1783947622.308885:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947622.309089:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947622.309116:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.309190:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.311585:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139008 00000100:00100000:2.0:1783947622.311600:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139008 00000100:00100000:2.0:1783947622.311709:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947622.311718:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17819:x1870604236139008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947622.311864:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17819:x1870604236139008:12345-0@lo:501:mount.lustre.0 Request processed in 148us (2746us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947622.311878:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947622.311960:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139008:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783947622.311981:0:17819:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783947622.312004:0:17819:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783947622.312013:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.312024:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947622.312052:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7bff95d000 10000000:01000000:0.0:1783947622.312056:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783947622.312061:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e7ac7798000 10000000:01000000:0.0:1783947622.312063:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783947622.312066:0:17819:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9e7ac7798000 from 1 10000000:01000000:0.0:1783947622.312069:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783947622.312098:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.312106:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.312115:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947622.312131:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947622.312158:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.324737:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.325063:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139136 00000100:00100000:2.0:1783947622.325073:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139136 00000100:00100000:2.0:1783947622.325128:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947622.325137:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+12:17819:x1870604236139136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947622.325152:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947622.325171:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846b400/0xe6fd1fdb55501359 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501352 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.325198:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846b400/0xe6fd1fdb55501359 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501352 expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.325208:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846b400/0xe6fd1fdb55501359 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501352 expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.325217:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b400, rc 0) 00000100:00100000:2.0:1783947622.325290:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+13:17819:x1870604236139136:12345-0@lo:101:mount.lustre.0 Request processed in 155us (13131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.325296:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783947622.326271:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139136:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947622.326306:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501359 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.326317:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501359 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947622.326341:0:17819:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783947622.326361:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501359 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.326369:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a400/0xe6fd1fdb55501352 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501359 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947622.326380:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e7bff95d000 10000000:01000000:0.0:1783947622.326395:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783947622.326401:0:17819:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9e7bff95d000 from 1 10000000:01000000:0.0:1783947622.326403:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783947622.326431:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.326439:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.326447:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947622.326486:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947622.326533:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.326559:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.326663:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139264 00000100:00100000:2.0:1783947622.326669:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139264 00000100:00100000:2.0:1783947622.326716:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947622.326724:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+13:17819:x1870604236139264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947622.326737:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947622.326751:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846a600/0xe6fd1fdb55501367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501360 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.326781:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846a600/0xe6fd1fdb55501367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501360 expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.326790:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846a600/0xe6fd1fdb55501367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501360 expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.326799:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a600, rc 0) 00000100:00100000:2.0:1783947622.326846:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+14:17819:x1870604236139264:12345-0@lo:101:mount.lustre.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.326853:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783947622.327120:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947622.327132:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.327141:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947622.327153:0:17819:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783947622.327203:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.327211:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ba00/0xe6fd1fdb55501360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501367 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947622.327218:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783947622.327222:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947622.327227:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e7bff95d000 10000000:01000000:0.0:1783947622.327229:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783947622.327232:0:17819:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1783947622.327234:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783947622.327249:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.327256:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.327264:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947622.327277:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947622.327314:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.327343:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947622.327415:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139392 00000100:00100000:3.0:1783947622.327420:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139392 00000100:00100000:3.0:1783947622.327482:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947622.327490:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+14:17819:x1870604236139392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947622.327499:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947622.327509:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e51a00/0xe6fd1fdb55501375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550136e expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947622.327523:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e51a00/0xe6fd1fdb55501375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550136e expref: 15 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947622.327532:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e51a00/0xe6fd1fdb55501375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550136e expref: 15 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947622.327537:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51a00, rc 0) 00000100:00100000:3.0:1783947622.327567:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139392:12345-0@lo:101:mount.lustre.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947622.327573:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783947622.327670:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947622.327681:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.327688:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947622.329440:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1783947622.330218:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947622.335337:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783947622.336042:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1783947622.336064:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1783947622.336077:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1783947622.336088:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1783947622.336099:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1783947622.336110:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1783947622.336121:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1783947622.336132:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1783947622.336145:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1783947622.336159:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1783947622.336172:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1783947622.336185:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1783947622.336198:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1783947622.336210:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1783947622.336222:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1783947622.336236:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1783947622.336249:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1783947622.336261:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1783947622.336275:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1783947622.336303:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1783947622.336316:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783947622.336329:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783947622.336359:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1783947622.336364:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1783947622.336556:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947622.336628:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.336725:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5c9b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783947622.336769:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139520 00000100:00100000:3.0:1783947622.336777:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139520 00000100:00100000:3.0:1783947622.336858:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783947622.336869:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947622.337228:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139520:12345-0@lo:501:mount.lustre.0 Request processed in 360us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947622.337238:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783947622.337318:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947622.337359:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139648:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947622.337414:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.337842:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947622.338027:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139648 00000100:00100000:0.0:1783947622.338034:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139648 00000100:00100000:0.0:1783947622.338066:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947622.338074:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947622.338765:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139648:12345-0@lo:503:mount.lustre.0 Request processed in 688us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947622.338775:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783947622.338878:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139648:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783947622.339444:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947622.339556:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947622.339603:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.339633:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100240 going to sleep for 11 seconds 00000100:00100000:0.0:1783947622.339701:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139776 00000100:00100000:0.0:1783947622.339707:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139776 00000100:00100000:0.0:1783947622.339734:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783947622.339741:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947622.340350:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139776:12345-0@lo:502:mount.lustre.0 Request processed in 607us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947622.340358:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947622.340453:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783947622.340691:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783947622.340721:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1783947622.340735:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1783947622.340749:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1783947622.340764:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1783947622.340779:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1783947622.340793:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1783947622.340808:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1783947622.340822:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1783947622.340834:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1783947622.340858:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1783947622.341044:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1783947622.341065:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1783947622.341076:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1783947622.341087:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1783947622.341100:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1783947622.341115:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1783947622.341131:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1783947622.341147:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1783947622.341164:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1783947622.341177:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1783947622.341188:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1783947622.341199:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1783947622.341211:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1783947622.341223:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1783947622.341236:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1783947622.341251:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1783947622.341266:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1783947622.341281:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1783947622.341296:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1783947622.341310:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1783947622.341323:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1783947622.341338:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1783947622.341353:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1783947622.341368:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1783947622.341382:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1783947622.341407:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1783947622.341419:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1783947622.341433:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1783947622.341445:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1783947622.341490:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1783947622.341509:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1783947622.341524:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1783947622.341550:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1783947622.341587:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947622.341639:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.341672:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100240 going to sleep for 11 seconds 00000100:00100000:3.0:1783947622.341739:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236139904 00000100:00100000:3.0:1783947622.341745:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236139904 00000100:00100000:3.0:1783947622.342042:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783947622.342051:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947622.342159:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236139904:12345-0@lo:502:mount.lustre.0 Request processed in 108us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947622.342166:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783947622.343259:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236139904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783947622.343336:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1783947622.343348:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1783947622.345176:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947622.345192:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.345195:0:17823:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1783947622.345204:0:17823:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1783947622.345208:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947622.345222:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9e7ac779b380) 00000020:00000080:3.0:1783947622.345244:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1783947622.345250:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783947622.345375:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783947622.345383:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb55501383 00000020:00000080:3.0:1783947622.345679:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1783947622.345683:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947622.345687:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.345689:0:17823:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1783947622.345692:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947622.345702:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.345704:0:17823:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1783947622.345709:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947622.345718:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9e7be7b40000) 00000020:00000080:3.0:1783947622.345730:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1783947622.345734:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783947622.345736:0:17823:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1783947622.345739:0:17823:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1783947622.345745:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783947622.345790:0:17823:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bff95d000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1783947622.345802:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9e7be7b43380) 00000020:00000080:3.0:1783947622.345811:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1783947622.346181:0:17823:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783947622.346189:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501398 00000020:00000080:3.0:1783947622.346285:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1783947622.346293:0:17823:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783947622.346297:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xe6fd1fdb5550139f 00080000:01000000:3.0:1783947622.346304:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783947622.346307:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb555013a6 00010000:00010000:2.0:1783947622.425289:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1783947622.426843:0:17823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1783947622.427477:0:17823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783947622.431527:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1783947622.431542:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947622.431549:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947622.431552:0:17823:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1783947622.431555:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947622.431561:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947622.431562:0:17823:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1783947622.431565:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783947622.431571:0:17823:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:00000080:2.0:1783947622.431600:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947622.431614:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9e7bc55119c0) 00000020:00000080:2.0:1783947622.431636:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1783947622.431642:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783947622.431720:0:17823:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1783947622.431727:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783947622.431734:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb555013b4 00010000:00080000:2.0:1783947622.431781:0:17823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bc5581800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:2.0:1783947622.433500:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1783947622.441006:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947622.441024:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783947622.441062:0:17823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783947622.441086:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb555013bb 00000100:00080000:3.0:1783947622.441098:0:17823:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947622.441105:0:17823:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9e7bc5581800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947622.441143:0:17823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c91f80 x1870604236140032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947622.441177:0:17823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1783947622.441246:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947622.441250:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.441251:0:17823:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1783947622.441254:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783947622.441262:0:17823:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783947622.441264:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947622.441266:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947622.441268:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783947622.441270:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.441271:0:17823:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783947622.441274:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947622.441278:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.441279:0:17823:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1783947622.441283:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783947622.441315:0:17823:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783947622.441327:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947622.441329:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.441343:0:17823:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1783947622.441346:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783947622.441347:0:17823:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783947622.441349:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947622.441350:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947622.441352:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783947622.441354:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.441356:0:17823:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783947622.441358:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783947622.441362:0:17823:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783947622.441365:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.441366:0:17823:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783947622.441368:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783947622.441372:0:17823:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:3.0:1783947622.441405:0:17823:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783947622.441408:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947622.441418:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9e7be7b419c0) 00000020:00000080:3.0:1783947622.441430:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783947622.441435:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783947622.441525:0:17823:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1783947622.441531:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000100:00080000:0.0:1783947622.441634:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783947622.441640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783947622.441644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947622.441649:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:0.0:1783947622.441654:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783947622.441664:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7c003f9000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947622.441681:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e3100 x1870604236140160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947622.441692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.441695:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947622.441698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.441700:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947622.441743:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236140288:0@lo:400:kworker.0 00000100:00100000:0.0:1783947622.441809:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.441877:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236140288 00000100:00100000:0.0:1783947622.441883:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236140288 00000100:00100000:0.0:1783947622.441926:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947622.441935:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236140288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947622.441939:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236140032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783947622.441993:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236140288:12345-0@lo:400:kworker.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.442001:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.442004:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947622.442040:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236140160:0@lo:38:kworker.0 00010000:00080000:0.0:1783947622.442046:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7ac76e0380 x1870604236140288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947622.442062:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236140288:0@lo:400:kworker.0 00000100:00100000:2.0:1783947622.442063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.442106:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236140032 00000100:00100000:2.0:1783947622.442110:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236140032 00000100:00100000:2.0:1783947622.442129:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236140160 00000100:00100000:2.0:1783947622.442132:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236140160 00000100:00100000:2.0:1783947622.442144:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947622.442150:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236140032:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783947622.442169:0:17093:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1783947622.442199:0:17093:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb555013c9 00000004:00100000:2.0:1783947622.442211:0:17093:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783947622.442217:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000080:3.0:1783947622.442502:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb555013d0 00010000:00080000:3.0:1783947622.442544:0:17823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bc5586000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947622.442778:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1783947622.443849:0:17823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783947622.444202:0:17823:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783947622.445858:0:17823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947622.446177:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783947622.446311:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1783947622.447152:0:17828:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783947622.447158:0:17828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783947622.449409:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947622.449425:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783947622.449507:0:17823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783947622.449529:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb555013d7 00000100:00080000:3.0:1783947622.449539:0:17823:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947622.449545:0:17823:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e7bc5586000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947622.449581:0:17823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c90e00 x1870604236140416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947622.449599:0:17823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783947622.449668:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947622.449672:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.449674:0:17823:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783947622.449677:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783947622.449680:0:17823:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1783947622.449682:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947622.449684:0:17823:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783947622.449685:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783947622.449688:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.449689:0:17823:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783947622.449691:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783947622.449695:0:17823:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783947622.449698:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.449700:0:17823:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783947622.449702:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783947622.449712:0:17823:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.103@tcp to nid 0x20000c0a8cc67 (192.168.204.103@tcp) 00000020:01000000:3.0:1783947622.449738:0:17823:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783947622.449743:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783947622.449754:0:17823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9e7be7b44d40) 00000020:00000080:3.0:1783947622.449766:0:17823:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783947622.449771:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783947622.449832:0:17823:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783947622.449839:0:17823:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783947622.449844:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xe6fd1fdb555013e5 00010000:00080000:3.0:1783947622.449885:0:17823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7bd1b69800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.103@tcp at head 00000100:00100000:2.0:1783947622.450051:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236140416:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783947622.450118:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236140416 offset 0 length 520: 4 00010000:00010000:3.0:1783947622.450667:0:17823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783947622.450744:0:17823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783947622.450757:0:17823:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1783947622.451325:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.451331:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947622.451334:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.451344:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1783947622.453283:0:17823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947622.453740:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783947622.453860:0:17823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783947622.454379:0:17830:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783947622.454394:0:17830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783947622.455162:0:17823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783947622.455174:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783947622.455211:0:17823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783947622.455231:0:17823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb555013ec 00000100:00080000:3.0:1783947622.455242:0:17823:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947622.455247:0:17823:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bd1b69800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947622.455280:0:17823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c93800 x1870604236140544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947622.455308:0:17823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783947622.455355:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947622.455358:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.455360:0:17823:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783947622.455372:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947622.455376:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.455378:0:17823:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783947622.455380:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783947622.455382:0:17823:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783947622.455398:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947622.455401:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.455402:0:17823:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783947622.455404:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947622.455407:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.455408:0:17823:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783947622.455411:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783947622.455433:0:17823:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947622.455437:0:17823:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947622.455438:0:17823:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783947622.455441:0:17823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1783947622.455685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.455690:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947622.455693:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.455695:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783947622.455759:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236140544:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783947622.455812:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236140544 offset 0 length 520: 4 00000100:00080000:1.0:1783947622.456172:0:17093:0:(import.c:65:import_set_state_nolock()) ffff9e7ac769a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947622.456294:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604236140032:12345-0@lo:38:llog_process_th.0 Request processed in 14141us (14292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.456308:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947622.456332:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947622.456338:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236140160:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783947622.456380:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1870604236140160:12345-0@lo:38:kworker.0 Request processed in 41us (14318us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783947622.456399:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:1.0:1783947622.456422:0:17819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1783947622.456503:0:17819:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783947622.456519:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.456531:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a600/0xe6fd1fdb5550136e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501375 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947622.456540:0:17819:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bff95d000 from 1 10000000:01000000:1.0:1783947622.456543:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947622.456570:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.456590:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.456599:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.456617:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236140672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947622.456651:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.456681:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236140672 00000100:00100000:1.0:1783947622.456688:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236140672 00000100:00100000:1.0:1783947622.456721:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947622.456727:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+15:17819:x1870604236140672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947622.456738:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947622.456749:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555013f3 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.456771:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 16 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.456780:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 16 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.456788:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55600, rc 0) 00000100:00100000:1.0:1783947622.456813:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+16:17819:x1870604236140672:12345-0@lo:101:mount.lustre.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.456819:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947622.456848:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.456888:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236140672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947622.456903:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.456912:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.457537:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236140800:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783947622.457573:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.457600:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236140800 00000100:00100000:1.0:1783947622.457604:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236140800 00000100:00100000:1.0:1783947622.457631:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947622.457638:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+16:17819:x1870604236140800:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783947622.457653:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783947622.457671:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783947622.457674:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783947622.457743:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+16:17819:x1870604236140800:12345-0@lo:256:mount.lustre.0 Request processed in 106us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.457751:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783947622.457779:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.457791:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236140800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783947622.458345:0:17819:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947622.458354:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.458363:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947622.458381:0:17819:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bff95d000 from 1 10000000:01000000:1.0:1783947622.458398:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947622.458419:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.458427:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.458435:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.458448:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236140928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947622.458501:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.458524:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236140928 00000100:00100000:1.0:1783947622.458528:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236140928 00000100:00100000:1.0:1783947622.458553:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783947622.458560:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+16:17819:x1870604236140928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947622.458570:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947622.458581:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501401 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.458599:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.458607:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.458616:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55800, rc 0) 00000100:00100000:1.0:1783947622.458647:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236140928:12345-0@lo:101:mount.lustre.0 Request processed in 88us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.458653:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783947622.458681:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.458695:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236140928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947622.458706:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.458714:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947622.458838:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947622.458865:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947622.458888:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.458906:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141056 00000100:00100000:1.0:1783947622.458909:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141056 00000100:00100000:1.0:1783947622.458929:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947622.458935:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947622.459005:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141056:12345-0@lo:501:mount.lustre.0 Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.459012:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783947622.459035:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.459046:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947622.459068:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947622.459106:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.459123:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141184 00000100:00100000:1.0:1783947622.459132:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141184 00000100:00100000:1.0:1783947622.459155:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947622.459160:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947622.459230:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141184:12345-0@lo:503:mount.lustre.0 Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.459237:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783947622.459268:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.459282:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947622.459851:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947622.459860:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783947622.460016:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783947622.460022:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783947622.460026:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5581800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947622.460092:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236140032:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947622.460110:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947622.460113:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947622.460117:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783947622.460120:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236140160:0@lo:38:kworker.0 00000040:00080000:1.0:1783947622.460440:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947622.460533:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947622.460579:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.460609:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7100f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947622.460703:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141312 00000100:00100000:0.0:1783947622.460709:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141312 00000100:00100000:0.0:1783947622.460775:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947622.460782:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947622.460894:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141312:12345-0@lo:502:mount.lustre.0 Request processed in 112us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947622.460900:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947622.461081:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947622.461276:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783947622.461303:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1783947622.461318:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1783947622.461333:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1783947622.461348:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1783947622.461360:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1783947622.461374:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1783947622.461401:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1783947622.461418:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783947622.461431:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1783947622.461444:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1783947622.461497:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947622.461534:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.461566:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141440 00000100:00100000:0.0:1783947622.461570:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141440 00000100:00100000:0.0:1783947622.461596:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947622.461603:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947622.461673:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141440:12345-0@lo:502:mount.lustre.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947622.461680:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947622.461714:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7ee20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947622.461727:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947622.461762:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1783947622.461770:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783947622.462528:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947622.462540:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462543:0:17832:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783947622.462551:0:17832:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bff95d000 00000020:00000080:1.0:1783947622.462554:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947622.462562:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947622.462565:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462567:0:17832:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783947622.462569:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947622.462572:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462573:0:17832:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783947622.462576:0:17832:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bff95d000 00000020:00000080:1.0:1783947622.462578:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947622.462632:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947622.462637:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462638:0:17832:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783947622.462640:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947622.462643:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462649:0:17832:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783947622.462653:0:17832:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bff95d000 00000020:00000080:1.0:1783947622.462655:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947622.462675:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947622.462678:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462679:0:17832:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783947622.462681:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947622.462683:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462684:0:17832:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783947622.462687:0:17832:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bff95d000 00000020:00000080:1.0:1783947622.462689:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783947622.462711:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947622.462714:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947622.462715:0:17832:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783947622.462718:0:17832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1783947622.469672:0:17819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783947622.469723:0:17819:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947622.474113:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.474133:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947622.474212:0:17819:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783947622.474215:0:17819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7bff95d000 10000000:01000000:2.0:1783947622.474218:0:17819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7bff95d000 10000000:01000000:2.0:1783947622.474222:0:17819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947622.474228:0:17819:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bff95d000 from 1 10000000:01000000:2.0:1783947622.474232:0:17819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783947622.474276:0:17819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.474285:0:17819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.474297:0:17819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947622.474323:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947622.474414:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.474470:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947622.475284:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141696 00000100:00100000:0.0:1783947622.475296:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141696 00000100:00100000:0.0:1783947622.475478:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783947622.475490:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17819:x1870604236141696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947622.475508:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947622.475524:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55501416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550140f expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.475550:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55501416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550140f expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.475562:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b200/0xe6fd1fdb55501416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550140f expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947622.475572:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b200, rc 0) 00000100:00100000:0.0:1783947622.475632:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236141696:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947622.475649:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783947622.475690:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236141568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947622.475726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947622.475774:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141568 00000100:00100000:0.0:1783947622.475778:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141568 00000100:00100000:0.0:1783947622.475805:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947622.475811:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236141568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947622.475837:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947622.475894:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236141568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947622.475900:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947622.477137:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236141568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947622.481557:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947622.481590:0:17819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947622.481603:0:17819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947622.493102:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1783947622.493426:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947622.493674:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783947622.493701:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1783947622.493716:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1783947622.493729:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1783947622.493741:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1783947622.493753:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1783947622.493765:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1783947622.493776:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1783947622.493790:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1783947622.493805:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1783947622.493819:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1783947622.493832:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1783947622.493845:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1783947622.493859:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1783947622.493888:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1783947622.493904:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1783947622.493927:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1783947622.493940:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1783947622.495120:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1783947622.495145:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1783947622.495160:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1783947622.495192:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1783947622.495208:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1783947622.495241:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1783947622.495258:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1783947622.495272:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1783947622.495285:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1783947622.495299:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1783947622.495335:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1783947622.495342:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1783947622.495475:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947622.495549:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.495594:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947622.495781:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141824 00000100:00100000:3.0:1783947622.495788:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141824 00000100:00100000:3.0:1783947622.495839:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783947622.495848:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236141824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947622.496150:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236141824:12345-0@lo:501:mount.lustre.0 Request processed in 302us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947622.496158:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783947622.497133:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947622.497181:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947622.497230:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.497260:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1783947622.497350:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236141952 00000100:00100000:3.0:1783947622.497363:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236141952 00000100:00100000:3.0:1783947622.497409:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947622.497419:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236141952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783947622.497534:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236141952:12345-0@lo:503:mount.lustre.0 Request processed in 117us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947622.497541:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783947622.498095:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236141952:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947622.498583:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947622.498659:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947622.498706:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.498742:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142080 00000100:00100000:2.0:1783947622.498747:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142080 00000100:00100000:2.0:1783947622.498779:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783947622.498787:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947622.498880:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142080:12345-0@lo:502:mount.lustre.0 Request processed in 92us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.498887:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783947622.503180:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.503230:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947622.503523:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783947622.503557:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1783947622.503573:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1783947622.503612:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1783947622.503628:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1783947622.503641:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1783947622.503653:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1783947622.503666:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1783947622.503679:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1783947622.503689:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1783947622.503700:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1783947622.503711:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1783947622.503721:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1783947622.503731:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1783947622.503741:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1783947622.503751:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1783947622.503762:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1783947622.503773:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1783947622.503784:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1783947622.503809:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1783947622.503822:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1783947622.503833:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1783947622.503845:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1783947622.503860:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1783947622.505116:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1783947622.505150:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1783947622.505164:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1783947622.505177:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1783947622.505191:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1783947622.505203:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1783947622.505216:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1783947622.505228:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1783947622.505241:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1783947622.505254:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1783947622.505267:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1783947622.505296:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1783947622.505319:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1783947622.505333:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1783947622.505347:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1783947622.505359:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1783947622.505370:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1783947622.505395:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1783947622.505413:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1783947622.505427:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1783947622.505440:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1783947622.505451:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1783947622.505491:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1783947622.505504:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1783947622.505562:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947622.505643:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.505684:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142208 00000100:00100000:2.0:1783947622.505693:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142208 00000100:00100000:2.0:1783947622.505737:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947622.505745:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947622.505861:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142208:12345-0@lo:502:mount.lustre.0 Request processed in 116us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.506065:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783947622.506113:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.506133:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947622.506292:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1783947622.506313:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1783947622.506333:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947622.506366:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.506401:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142336 00000100:00100000:2.0:1783947622.506410:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142336 00000100:00100000:2.0:1783947622.506434:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947622.506439:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947622.506536:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142336:12345-0@lo:502:mount.lustre.0 Request processed in 96us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.506543:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783947622.506572:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.506586:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947622.506619:0:17819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1783947622.506627:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783947622.508769:0:17839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1783947622.508799:0:17839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9e7be3f30000) 00000020:00000080:3.0:1783947622.508821:0:17839:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1783947622.509026:0:17839:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bff95d000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1783947622.509031:0:17839:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bff95d000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1783947622.509033:0:17839:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bff95d000 3 00010000:00080000:3.0:1783947622.509067:0:17839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac77ce000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.103@tcp at head 00010000:00010000:3.0:1783947622.510677:0:17839:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1783947622.510777:0:17839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1783947622.510819:0:17839:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783947622.510831:0:17839:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xe6fd1fdb55501424 00000100:00080000:3.0:1783947622.510842:0:17839:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783947622.510847:0:17839:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9e7ac77ce000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947622.510882:0:17839:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c93480 x1870604236142464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947622.510910:0:17839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783947622.511124:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236142464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947622.511200:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783947622.511450:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1783947622.511517:0:17819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783947622.511552:0:17819:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947622.511577:0:17819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.511587:0:17819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b800/0xe6fd1fdb5550140f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501416 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783947622.511635:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783947622.511637:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783947622.511639:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947622.511640:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947622.511641:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947622.511642:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947622.511644:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783947622.511645:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947622.511647:0:17819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947622.511656:0:17819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1783947622.511658:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947622.511659:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783947622.511660:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947622.511661:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947622.511662:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947622.511662:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947622.511663:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783947622.511664:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947622.511665:0:17819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947622.511682:0:17819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783947622.511695:0:17819:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6611880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947622.511733:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947622.511754:0:17819:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947622.511774:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142592 00000100:00100000:2.0:1783947622.511781:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142592 00000100:00100000:2.0:1783947622.511824:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947622.511832:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783947622.511856:0:17081:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783947622.511868:0:17081:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1783947622.512565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.512571:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947622.512574:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947622.512576:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947622.513315:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142464 00000100:00100000:3.0:1783947622.513326:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142464 00000100:00100000:3.0:1783947622.513368:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947622.513376:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1870604236142464:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783947622.513410:0:17089:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1783947622.513445:0:17089:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xe6fd1fdb5550142b 00000004:00100000:3.0:1783947622.516068:0:17089:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947622.516123:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9e7ac674e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947622.516218:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1870604236142464:12345-0@lo:38:llog_process_th.0 Request processed in 2838us (5015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947622.516228:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783947622.516294:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7ac7c93480 x1870604236142464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947622.516305:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947622.516314:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783947622.516323:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783947622.516329:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783947622.516332:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac77ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783947622.516338:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1870604236142464:0@lo:38:llog_process_th.0 00000001:00100000:1.0:1783947622.517439:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1783947622.517576:0:17081:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783947622.518151:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1783947622.522855:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783947622.523036:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783947622.523060:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.523080:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.523088:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 18 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.523095:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.523136:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 18 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.523164:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 18 pid: 17080 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.523180:0:17103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236142720:0@lo:104: 00000100:00100000:1.0:1783947622.523250:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783947622.523597:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.523607:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 18 pid: 17081 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.523616:0:17103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236142848:0@lo:104: 00000100:00100000:1.0:1783947622.523640:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.523709:0:17103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc649d840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947622.523934:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17819:x1870604236142592:12345-0@lo:253:mount.lustre.0 Request processed in 12101us (12198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947622.523953:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947622.524172:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142720 00000100:00100000:2.0:1783947622.524180:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142720 00000100:00100000:2.0:1783947622.524211:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142848 00000100:00100000:2.0:1783947622.524214:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142848 00000100:00100000:2.0:1783947622.524227:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947622.524235:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:17103:x1870604236142720:12345-0@lo:104: 00010000:00010000:2.0:1783947622.524249:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.524308:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947622.524322:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:17103:x1870604236142720:12345-0@lo:104: Request processed in 88us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.524328:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783947622.524341:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947622.524347:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236142848:12345-0@lo:104: 00010000:00010000:2.0:1783947622.524355:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947622.524399:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947622.524404:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236142848:12345-0@lo:104: Request processed in 58us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947622.524410:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947622.524497:0:17819:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6611880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17819:1870604236142592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783947622.524509:0:17819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783947622.524513:0:17819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947622.524514:0:17819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783947622.524516:0:17819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947622.524517:0:17819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947622.524519:0:17819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947622.524520:0:17819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947622.524521:0:17819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783947622.524522:0:17819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947622.524523:0:17819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783947622.524536:0:17819:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783947622.525098:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947622.525107:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525116:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947622.525121:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525129:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947622.525136:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947622.525142:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947622.525184:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525190:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947622.525211:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525218:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55000/0xe6fd1fdb555013f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555013fa expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525230:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947622.525233:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525239:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947622.525241:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525247:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947622.525252:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947622.525257:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947622.525267:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525272:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947622.525278:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525293:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51800/0xe6fd1fdb5550132f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501336 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525306:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947622.525307:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947622.525309:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947622.525324:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236142976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947622.525364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.525414:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947622.525420:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236143104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947622.525441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.525486:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236142976 00000100:00100000:1.0:1783947622.525491:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236142976 00010000:00010000:1.0:1783947622.525515:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 18 pid: 17080 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.525539:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236143104 00000100:00100000:1.0:1783947622.525541:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236143104 00010000:00010000:1.0:1783947622.525553:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 19 pid: 17081 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.525568:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947622.525575:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:3639:x1870604236142976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947622.525586:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947622.525591:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 19 pid: 17080 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525602:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 19 pid: 17080 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525625:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947622.525655:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:3639:x1870604236142976:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.525662:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947622.525681:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947622.525687:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3639:x1870604236143104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947622.525695:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947622.525699:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 18 pid: 17081 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525707:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 18 pid: 17081 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525720:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525727:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783947622.525744:0:17072:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012079822s 00010000:00010000:1.0:1783947622.525748:0:17072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525754:0:17072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525761:0:17072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525775:0:17072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525780:0:17072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947622.525784:0:17072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525790:0:17072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525798:0:17072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.525809:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947622.525833:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3639:x1870604236143104:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.525839:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947622.525926:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236143104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947622.525936:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236142976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783947622.526081:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947622.526138:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55600/0xe6fd1fdb555013fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555013f3 expref: 17 pid: 17080 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.526148:0:17103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236142720:0@lo:104: 00010000:00010000:1.0:1783947622.526158:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55e00/0xe6fd1fdb55501336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550132f expref: 16 pid: 17081 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947622.526165:0:17103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236142848:0@lo:104: 00010000:00010000:1.0:1783947622.526185:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.526192:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.526198:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947622.526204:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501432 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1783947622.537641:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1783947622.537848:0:17844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783947622.538106:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783947622.538401:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1870604236143232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.538508:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.538552:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236143232 00000100:00100000:1.0:1783947622.538559:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236143232 00000100:00100000:1.0:1783947622.538602:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947622.538610:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1870604236143232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.538702:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1870604236143232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.538710:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947622.538739:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.538765:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1870604236143232:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1783947622.538793:0:17845:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783947622.538818:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1870604236143360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.538849:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.538875:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236143360 00000100:00100000:1.0:1783947622.538879:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236143360 00000100:00100000:1.0:1783947622.538901:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947622.538907:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1870604236143360:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1783947622.539147:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1783947622.539189:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1783947622.539667:0:17819:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783947622.539676:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1783947622.539713:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783947622.540128:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1870604236143360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1217us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.540138:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947622.540172:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.540192:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1870604236143360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.540257:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17845:1870604236143488:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.540291:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.540320:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9e540 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.540771:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236143488 00000100:00100000:1.0:1783947622.540779:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236143488 00000100:00100000:1.0:1783947622.540824:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947622.540833:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17845:x1870604236143488:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.540896:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17845:x1870604236143488:12345-0@lo:900:lod0001_rec0000.0 Request processed in 64us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.540904:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1783947622.541898:0:17819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:1.0:1783947622.542153:0:17845:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e7bf7d69180 x1870604236143488/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947638 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947622.542170:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17845:1870604236143488:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.542250:0:17845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1870604236143616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.542303:0:17845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947622.542339:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236143616 00000100:00100000:1.0:1783947622.542355:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236143616 00000100:00100000:1.0:1783947622.542398:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947622.542408:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1870604236143616:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783947622.542501:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17845:x1870604236143616:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947622.542508:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947622.542532:0:17845:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783947622.542545:0:17845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17845:1870604236143616:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783947622.542589:0:17845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1783947622.543060:0:17843:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1783947622.543065:0:17843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1783947622.544799:0:17819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783947622.544864:0:17819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783947622.546281:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947622.546517:0:17844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783947622.550282:0:17819:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1783947622.552812:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783947622.552895:0:17845:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00000004:0.0:1783947622.554737:0:17819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1783947622.555183:0:17844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783947622.555243:0:17844:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783947622.555248:0:17844:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1783947622.556787:0:17819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783947622.556820:0:17819:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb79485543988 00100000:10000000:0.0:1783947622.556829:0:17819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783947622.557947:0:17819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783947622.557974:0:17819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783947622.557995:0:17819:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783947622.558012:0:17819:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783947622.558797:0:17819:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947622.559009:0:17819:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783947622.645960:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:1.0:1783947623.156671:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947623.540376:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783947623.669195:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 10000000:01000000:1.0:1783947623.923667:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947623.923677:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bff95d000 from 8 10000000:01000000:1.0:1783947623.923682:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947623.923736:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.923749:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.923761:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947623.923787:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236143744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947623.923864:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947623.924935:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947623.925440:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236143744 00000100:00100000:2.0:1783947623.925495:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236143744 00000100:00100000:2.0:1783947623.925572:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783947623.925582:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+16:17085:x1870604236143744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947623.925598:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947623.925617:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501439 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947623.925644:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947623.925655:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947623.925663:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846ac00, rc 0) 00000100:00100000:2.0:1783947623.925728:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236143744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947623.925735:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783947623.926711:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236143744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947623.926746:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.926757:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947623.926816:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236143872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783947623.926970:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947623.927057:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947623.927076:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236143872 00000100:00100000:3.0:1783947623.927090:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236143872 00000100:00100000:3.0:1783947623.927170:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947623.927184:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236143872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783947623.927217:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783947623.927243:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783947623.927252:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783947623.927435:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236143872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 255us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947623.927446:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783947623.927499:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236143872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783947623.927575:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947623.927583:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.927591:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947623.927601:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947623.927603:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7ac7ff8000 from 8 10000000:01000000:1.0:1783947623.927606:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947623.927631:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.927639:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.927654:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947623.927677:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236144000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947623.927712:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947623.927734:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947623.927764:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144000 00000100:00100000:0.0:1783947623.927773:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144000 00000100:00100000:0.0:1783947623.927814:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783947623.927823:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236144000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947623.927837:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947623.927869:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501447 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947623.928204:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947623.928220:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947623.928231:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b000, rc 0) 00000100:00100000:0.0:1783947623.928305:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236144000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 474us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947623.928313:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783947623.929539:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236144000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947623.929570:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.929584:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947623.929682:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236144128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783947623.930011:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947623.930130:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c9ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947623.935124:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144128 00000100:00100000:3.0:1783947623.935147:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144128 00000100:00100000:3.0:1783947623.935246:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783947623.935260:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236144128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783947623.935301:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783947623.936597:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783947623.936604:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783947623.941073:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236144128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 5801us (11047us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947623.941092:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947623.953209:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236144128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783947623.954028:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783947623.954045:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947623.954059:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947624.181786:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947624.565184:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783947624.694650:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:1.0:1783947625.210165:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947625.721019:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00010000:00010000:0.0:1783947626.229730:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947626.744548:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00000001:02000400:2.0:1783947627.152667:0:18088:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783947627.254071:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947627.766545:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd0190d80 going to sleep for 0 seconds 00000100:00080000:0.0:1783947627.766672:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783947627.766677:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783947627.766680:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947627.766692:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9e7c003f9000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947627.766715:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e2300 x1870604236144384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947627.766733:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947627.766736:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947627.766739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947627.766742:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947627.766768:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947627.766772:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947627.766774:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947627.766777:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947627.766807:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236144256:0@lo:400:kworker.0 00000100:00100000:0.0:1783947627.766875:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947627.766928:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947627.766934:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236144512:0@lo:400:kworker.0 00000100:00100000:0.0:1783947627.766961:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947627.766993:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236144384:0@lo:38:kworker.0 00000100:00100000:0.0:1783947627.767024:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947627.767072:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236144768:0@lo:400:kworker.0 00000100:00100000:3.0:1783947627.767211:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947627.767219:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236144896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947627.767249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947627.769546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947627.769593:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947627.769604:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236144640:0@lo:400:kworker.0 00000100:00100000:0.0:1783947627.769630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947627.769658:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144256 00000100:00100000:0.0:1783947627.769666:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144256 00000100:00100000:0.0:1783947627.769718:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947627.769726:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3637:x1870604236144256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947627.769788:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3637:x1870604236144256:12345-0@lo:400:kworker.0 Request processed in 62us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947627.769796:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947627.769829:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144512 00000100:00100000:0.0:1783947627.769834:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144512 00000100:00100000:0.0:1783947627.769856:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144768 00000100:00100000:0.0:1783947627.769859:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144768 00000100:00100000:0.0:1783947627.769873:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947627.769878:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236144512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947627.769912:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1870604236144512:12345-0@lo:400:kworker.0 Request processed in 33us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947627.769918:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783947627.769931:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947627.769937:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236144768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947627.769969:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236144768:12345-0@lo:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947627.769975:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947627.769993:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144384 00000100:00100000:0.0:1783947627.770002:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144384 00000100:00100000:0.0:1783947627.770016:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144896 00000100:00100000:0.0:1783947627.770018:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144896 00000100:00100000:0.0:1783947627.770030:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236144640 00000100:00100000:0.0:1783947627.770032:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236144640 00000100:00100000:0.0:1783947627.770042:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783947627.770046:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1870604236144384:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783947627.770071:0:17092:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1783947627.770108:0:17092:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501455 00000004:00100000:0.0:1783947627.770122:0:17092:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783947627.770128:0:17092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:0.0:1783947627.770222:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac76e1180 x1870604236144512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947627.770236:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1870604236144512:0@lo:400:kworker.0 00000100:00100000:0.0:1783947627.770247:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236144256:0@lo:400:kworker.0 00010000:00080000:0.0:1783947627.770397:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac76e3800 x1870604236144768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947627.770407:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236144768:0@lo:400:kworker.0 00000100:00080000:1.0:1783947627.785377:0:17092:0:(import.c:65:import_set_state_nolock()) ffff9e7bc7e0a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947627.785492:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604236144384:12345-0@lo:38:kworker.0 Request processed in 15442us (18465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947627.785515:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947627.785546:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947627.785556:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236144896:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1783947627.785561:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783947627.785570:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783947627.785575:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783947627.785578:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7c003f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000004:00000024:1.0:1783947627.785587:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783947627.785627:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1870604236144896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (18376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947627.785633:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1783947627.785635:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000dfc34368): req@ffff9e7bf7d6aa00 x1870604236137472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947627.785646:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947627.785653:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236144384:0@lo:38:kworker.0 00000100:00100000:1.0:1783947627.785653:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236144640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947627.785686:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236144640:12345-0@lo:400:kworker.0 Request processed in 35us (16056us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947627.785693:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947627.785726:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236144896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947627.785969:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236145024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947627.787451:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947627.787606:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236137472 00000100:00100000:3.0:1783947627.787615:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236137472 00000100:00100000:3.0:1783947627.787702:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947627.787711:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17129:x1870604236137472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783947627.787817:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17129:x1870604236137472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947627.787825:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947627.790618:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17129:1870604236137472:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783947627.790687:0:17129:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783947627.790747:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17129:1870604236145152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783947627.790935:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947627.791015:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a1a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947627.791197:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145152 00000100:00100000:2.0:1783947627.791205:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145152 00000100:00100000:2.0:1783947627.791338:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947627.791349:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17129:x1870604236145152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783947627.791515:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17129:x1870604236145152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 167us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947627.791523:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947627.791632:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17129:1870604236145152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783947627.791702:0:17129:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17129:1870604236145280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783947627.791728:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947627.793132:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236144640:0@lo:400:kworker.0 00000100:00100000:2.0:1783947627.793802:0:17129:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783947627.794140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947627.799952:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145280 00000100:00100000:3.0:1783947627.799967:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145280 00000100:00100000:3.0:1783947627.800020:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145024 00000100:00100000:3.0:1783947627.800023:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145024 00000100:00100000:3.0:1783947627.800042:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947627.800051:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17129:x1870604236145280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783947627.800198:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17129:x1870604236145280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 147us (8467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947627.800205:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947627.800223:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947627.800229:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236145024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947627.800253:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947627.800305:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236145024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (6166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947627.800311:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947627.800357:0:17129:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17129:1870604236145280:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1783947627.800420:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783947627.802481:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783947627.802564:0:17129:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1783947627.802570:0:17129:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1783947627.804760:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236145024:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1783947628.115120:0:18140:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947628.115391:0:18140:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783947628.275769:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783947629.153676:0:18190:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783947629.154133:0:18190:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947629.300598:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947630.325663:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947630.352015:0:18238:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5a49f360 20000000:00000080:1.0:1783947630.352032:0:18238:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7c007dfc00 uarg=0000000000000000 20000000:01000000:1.0:1783947630.352071:0:18238:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783947630.352077:0:18238:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783947630.352082:0:18238:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783947630.352749:0:18239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1783947630.352919:0:18238:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783947630.363055:0:18238:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783947630.366821:0:18238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.366861:0:18238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 17 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.366869:0:18238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.366878:0:18238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.366922:0:18238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.366938:0:18238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 17 pid: 17082 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947630.366955:0:18238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18238:1870604236145408:0@lo:104: 00000100:00100000:0.0:1783947630.367027:0:18238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947630.367087:0:18238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 17 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.367096:0:18238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 17 pid: 17081 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947630.367104:0:18238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18238:1870604236145536:0@lo:104: 00000100:00100000:0.0:1783947630.367127:0:18238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947630.367145:0:18238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947630.367420:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145408 00000100:00100000:1.0:1783947630.367429:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145408 00000100:00100000:1.0:1783947630.367490:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145536 00000100:00100000:1.0:1783947630.367494:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145536 00000100:00100000:1.0:1783947630.367508:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947630.367524:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:18238:x1870604236145408:12345-0@lo:104: 00010000:00010000:1.0:1783947630.367538:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947630.367669:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947630.367676:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:18238:x1870604236145408:12345-0@lo:104: Request processed in 153us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947630.367684:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947630.367702:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947630.367708:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:18238:x1870604236145536:12345-0@lo:104: 00010000:00010000:1.0:1783947630.367715:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947630.367755:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783947630.367759:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:18238:x1870604236145536:12345-0@lo:104: Request processed in 52us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947630.367764:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1783947630.368161:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947630.368176:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368185:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947630.368190:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368199:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947630.368206:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947630.368213:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947630.368262:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368269:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947630.368295:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368302:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54e00/0xe6fd1fdb55501401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501408 expref: -99 pid: 17819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368316:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947630.368319:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368324:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d54400 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:3.0:1783947630.368326:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368342:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783947630.368348:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947630.368353:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783947630.368371:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368376:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783947630.368382:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368388:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb555012fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501305 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947630.368400:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947630.368402:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947630.368403:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947630.368409:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947630.368640:0:18238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18238:1870604236145408:0@lo:104: 00000100:00100000:0.0:1783947630.368651:0:18238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18238:1870604236145536:0@lo:104: 00010000:00010000:0.0:1783947630.368672:0:18238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947630.369547:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236145664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947630.369606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947630.369667:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145664 00000100:00100000:1.0:1783947630.369836:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236145792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947630.369868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947630.370112:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145664 00010000:00010000:0.0:1783947630.370146:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 18 pid: 17082 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947630.370182:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145792 00000100:00100000:0.0:1783947630.370186:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145792 00010000:00010000:0.0:1783947630.370197:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 19 pid: 17081 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947630.370212:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947630.370220:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:3639:x1870604236145664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947630.370244:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947630.370250:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 19 pid: 17082 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370262:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 19 pid: 17082 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370280:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb55501408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501401 expref: 19 pid: 17082 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370293:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947630.370384:0:17072:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783947630.370389:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3639:x1870604236145664:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947630.370396:0:17072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783947630.370400:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947630.370419:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947630.370426:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:3640:x1870604236145792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947630.370447:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947630.370453:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 17 pid: 17081 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370488:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 17 pid: 17081 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370499:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb55501305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555012fe expref: 17 pid: 17081 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370512:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370520:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370533:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370541:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370548:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370555:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370562:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947630.370566:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370583:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370598:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370608:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947630.370638:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+16:3640:x1870604236145792:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947630.370645:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947630.370677:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236145792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947630.370707:0:18238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370729:0:18238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947630.370736:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9a800/0xe6fd1fdb5550145c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947630.373202:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236145664:0@lo:103:ldlm_bl.0 00000040:00080000:2.0:1783947630.772075:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783947631.348567:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783947631.605539:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947631.605550:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bff95d000 from 13 10000000:01000000:2.0:1783947631.605557:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947631.605627:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.605641:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.605655:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947631.606491:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236145920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.606597:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947631.606656:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947631.606711:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236145920 00000100:00100000:2.0:1783947631.606719:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236145920 00000100:00100000:2.0:1783947631.606788:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783947631.606800:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+16:17085:x1870604236145920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947631.606822:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947631.606844:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501463 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.606879:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 17 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.606892:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 17 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.606904:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846ae00, rc 0) 00000100:00100000:2.0:1783947631.606951:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236145920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947631.606958:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783947631.607057:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236145920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947631.607076:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.607087:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947631.607191:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.607237:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947631.607256:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947631.607283:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146048 00000100:00100000:2.0:1783947631.607287:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146048 00000100:00100000:2.0:1783947631.607312:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947631.607319:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236146048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.607504:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236146048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947631.607512:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783947631.607546:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.607577:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.607622:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947631.607642:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947631.607655:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146176 00000100:00100000:2.0:1783947631.607659:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146176 00000100:00100000:2.0:1783947631.607682:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783947631.607689:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd554b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236146176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.607777:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd554b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236146176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947631.607784:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783947631.607828:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783947631.611216:0:18301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783947631.611585:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783947631.611619:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783947631.611636:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.611651:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947631.611665:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783947631.611669:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7ac7ff8000 from 13 10000000:01000000:2.0:1783947631.611673:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947631.611789:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.611798:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.611810:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947631.611844:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.611940:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947631.611992:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947631.612039:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146304 00000100:00100000:2.0:1783947631.612048:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146304 00000100:00100000:2.0:1783947631.612105:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947631.612116:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd554a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+17:17085:x1870604236146304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947631.612135:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947631.612151:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501471 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.612199:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.613833:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 18 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.613849:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a000, rc 0) 00000100:00100000:2.0:1783947631.613945:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd554a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236146304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1829us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947631.613955:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947631.614056:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947631.614080:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947631.614092:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947631.614196:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.616591:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947631.616653:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947631.616687:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146432 00000100:00100000:2.0:1783947631.617929:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146432 00000100:00100000:2.0:1783947631.618024:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783947631.618037:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd5549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236146432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.618263:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd5549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236146432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947631.619847:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783947631.619972:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.620042:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.620114:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947631.620156:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783947631.620174:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146560 00000100:00100000:2.0:1783947631.620180:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146560 00000100:00100000:2.0:1783947631.620236:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783947631.620245:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd5548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236146560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947631.623023:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd5548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:17085:x1870604236146560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2764us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947631.623044:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783947631.625070:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236146560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783947631.630571:0:18302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783947631.631538:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783947631.631576:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947631.631591:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947631.631606:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947632.376934:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783947632.886547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.886556:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947632.886560:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.886563:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947632.887194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.887199:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947632.887222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.887225:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947632.887285:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947622/real 1783947622] req@ffff9e7ac7c93800 x1870604236140544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947632.887435:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac7c93800 x1870604236140544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947632.887448:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947622/real 1783947622] req@ffff9e7ac7c90e00 x1870604236140416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947632.887494:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac7c90e00 x1870604236140416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947632.887521:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947632.887542:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947632.887547:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236140544:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783947632.887553:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5586000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947632.887558:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947632.887562:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236140416:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783947632.887724:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236146688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947632.887811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947632.887851:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236147200:0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.887877:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947632.887898:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783947632.887904:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236146816:0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.887946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947632.887974:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236147328:0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.887999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947632.888032:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236146944:0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.888055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947632.888067:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947632.888074:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236147072:0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.888094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947632.888132:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146688 00000100:00100000:0.0:1783947632.888141:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146688 00000100:00100000:2.0:1783947632.888452:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146816 00000100:00100000:2.0:1783947632.888474:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146816 00000100:00100000:2.0:1783947632.888535:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783947632.888545:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bff948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3637:x1870604236146816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947632.888819:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bff948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3637:x1870604236146816:12345-0@lo:400:kworker.0 Request processed in 274us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947632.888828:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783947632.888919:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236146816:0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.889522:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236147200 00000100:00100000:0.0:1783947632.889529:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236147200 00000100:00100000:0.0:1783947632.889544:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236146944 00000100:00100000:0.0:1783947632.889546:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236146944 00000100:00100000:0.0:1783947632.889558:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947632.889566:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236146688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947632.889924:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947632.890050:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236146688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 483us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947632.890058:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947632.890079:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947632.890086:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236147200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.890119:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236147200:12345-0@lo:400:kworker.0 Request processed in 35us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947632.890127:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947632.890139:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947632.890157:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236146944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.890227:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236146944:12345-0@lo:400:kworker.0 Request processed in 81us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947632.890234:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783947632.890266:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236147328 00000100:00100000:0.0:1783947632.890271:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236147328 00000100:00100000:0.0:1783947632.890307:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236147072 00000100:00100000:0.0:1783947632.890670:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236147072 00000100:00100000:0.0:1783947632.890697:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947632.890705:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236147328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.890747:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236147328:12345-0@lo:400:kworker.0 Request processed in 44us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947632.890754:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947632.890766:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947632.890772:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236147072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.890800:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236147072:12345-0@lo:400:kworker.0 Request processed in 28us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947632.890806:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783947632.890841:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.890847:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947632.890850:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.890853:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947632.890858:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.890862:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783947632.890866:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5586000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947632.890871:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1783947632.890886:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783947632.890892:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e7bc5586000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947632.890932:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac85eca80 x1870604236147456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947632.890959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947632.890962:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783947632.890964:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947632.890968:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1783947632.890971:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783947632.890974:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bd1b69800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947632.890990:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac85ed180 x1870604236147584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947632.891024:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236147456:0@lo:8:kworker.0 00000400:00000100:0.0:1783947632.891065:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236147456 offset 0 length 520: 4 00000100:00100000:0.0:1783947632.891097:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236147584:0@lo:8:kworker.0 00000400:00000100:0.0:1783947632.891119:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236147584 offset 0 length 520: 4 00010000:00080000:3.0:1783947632.893821:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac76e2d80 x1870604236147072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947632.893845:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236147072:0@lo:400:kworker.0 00000100:00100000:3.0:1783947632.893863:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236146944:0@lo:400:kworker.0 00000100:00100000:0.0:1783947632.894553:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947632.894572:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236147712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947632.894670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947632.894722:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236147712 00000100:00100000:0.0:1783947632.894729:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236147712 00000100:00100000:0.0:1783947632.894780:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783947632.894789:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236147712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947632.894832:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947632.894879:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236147712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947632.894893:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783947632.894940:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236147712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947632.900134:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236146688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947632.900778:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236147200:0@lo:400:kworker.0 00010000:00080000:3.0:1783947632.900824:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac76e0000 x1870604236147328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947632.900837:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236147328:0@lo:400:kworker.0 00010000:00010000:2.0:1783947633.400510:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947633.907576:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947618/real 1783947618] req@ffff9e7ac76e3480 x1870604236138496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947633 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947633.907615:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac76e3480 x1870604236138496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947633 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947633.907626:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947618/real 1783947618] req@ffff9e7ac76e1f80 x1870604236138624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947633 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947633.907640:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac76e1f80 x1870604236138624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947633 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947633.907665:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947633.907694:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947633.907698:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236138496:0@lo:8:kworker.0 00000100:00080000:0.0:1783947633.907706:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947633.907713:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947633.907716:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236138624:0@lo:8:kworker.0 00000100:00080000:0.0:1783947633.907840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947633.907845:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783947633.907848:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947633.907853:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:0.0:1783947633.907860:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947633.907868:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bd10ba800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947633.907903:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac85ed880 x1870604236148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947633.907917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947633.907920:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783947633.907922:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947633.907925:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:0.0:1783947633.907928:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783947633.907932:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7bc47c4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947633.907943:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac85ed500 x1870604236148224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947633.907965:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947633.907970:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947633.907974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947633.907978:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947633.908012:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236147840:0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947633.908159:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236148608:0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947633.908230:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783947633.908236:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236148480:0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947633.908297:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236148352:0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947633.908352:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947633.908357:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236147968:0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947633.908417:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236147840 00000100:00100000:0.0:1783947633.908427:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236147840 00000100:00100000:0.0:1783947633.908518:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783947633.908530:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bff949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3640:x1870604236147840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908591:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bff949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:3640:x1870604236147840:12345-0@lo:400:kworker.0 Request processed in 63us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947633.908599:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783947633.908640:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236148608 00000100:00100000:0.0:1783947633.908644:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236148608 00000100:00100000:0.0:1783947633.908671:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236148352 00000100:00100000:0.0:1783947633.908674:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236148352 00000100:00100000:0.0:1783947633.908689:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947633.908695:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236148608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908729:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236148608:12345-0@lo:400:kworker.0 Request processed in 34us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947633.908736:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947633.908750:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947633.908756:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236148352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908785:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236148352:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947633.908791:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947633.908811:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236148480 00000100:00100000:0.0:1783947633.908814:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236148480 00000100:00100000:0.0:1783947633.908831:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236147968 00000100:00100000:0.0:1783947633.908833:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236147968 00000100:00100000:0.0:1783947633.908860:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947633.908865:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908899:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236148480:12345-0@lo:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947633.908905:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783947633.908916:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947633.908921:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236147968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.908944:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236147968:12345-0@lo:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947633.908950:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947633.909003:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236147968:0@lo:400:kworker.0 00010000:00080000:0.0:1783947633.909017:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac85edf80 x1870604236148352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947633.909027:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236148352:0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.909059:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236148096:0@lo:8:kworker.0 00000400:00000100:0.0:1783947633.909088:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236148096 offset 0 length 520: 4 00000100:00100000:0.0:1783947633.909101:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236148224:0@lo:8:kworker.0 00000400:00000100:0.0:1783947633.909123:0:3636:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870604236148224 offset 0 length 520: 4 00000100:00100000:0.0:1783947633.909152:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236148480:0@lo:400:kworker.0 00000100:00100000:0.0:1783947633.909161:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236147840:0@lo:400:kworker.0 00010000:00080000:0.0:1783947633.909186:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac85efb80 x1870604236148608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947633.909195:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236148608:0@lo:400:kworker.0 00000001:00100000:1.0:1783947633.925868:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1783947634.420935:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783947634.805612:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783947635.443582:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947636.470787:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947637.493522:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947638.004150:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947638.004173:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236148736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947638.004255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.004313:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236148736 00000100:00100000:0.0:1783947638.004320:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236148736 00000100:00100000:0.0:1783947638.004368:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947638.004377:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236148736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947638.004416:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947638.004506:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236148736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.004514:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947638.004561:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236148736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947638.005079:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236148864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947638.005121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.005175:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236148864 00000100:00100000:2.0:1783947638.005180:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236148864 00000100:00100000:2.0:1783947638.005223:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947638.005230:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236148864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947638.005251:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783947638.006246:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236148864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1013us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947638.006257:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783947638.007183:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236148864:0@lo:41:osp-pre-0-1.0 00000020:01000004:1.0:1783947638.427196:0:18588:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783947638.427200:0:18588:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783947638.427275:0:18588:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783947638.427393:0:18588:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7bc7e0a000 00000020:01000004:1.0:1783947638.427410:0:18588:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783947638.427424:0:18588:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783947638.427438:0:18588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e7bf3fb0000) 00000020:00000080:1.0:1783947638.427492:0:18588:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783947638.488383:0:18588:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783947638.491027:0:18588:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783947638.491352:0:18588:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783947638.491735:0:18588:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783947638.492072:0:18588:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783947638.492366:0:18588:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1783947638.492619:0:18588:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1783947638.494753:0:18588:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783947638.494965:0:18588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783947638.494978:0:18588:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783947638.494989:0:18588:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6fd1fdb55501486 00000020:01000004:1.0:1783947638.494995:0:18588:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783947638.495017:0:18588:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783947638.495020:0:18588:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783947638.495026:0:18588:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783947638.495031:0:18588:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783947638.495041:0:18588:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e7bc47bcd40) 00000020:00000080:1.0:1783947638.495053:0:18588:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1783947638.500897:0:18588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783947638.501067:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783947638.501092:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783947638.501812:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783947638.501820:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783947638.502218:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783947638.502225:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783947638.503915:0:18588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947638.504104:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783947638.504111:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783947638.507782:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783947638.507795:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:0.0:1783947638.517333:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947638.532868:0:18588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947638.533117:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783947638.533123:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783947638.536342:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783947638.536358:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783947638.537348:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783947638.537356:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783947638.539949:0:18588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783947638.540132:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783947638.540138:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783947638.541739:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783947638.541749:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783947638.598502:0:18588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783947638.598739:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783947638.598746:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783947638.609026:0:18588:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783947638.609044:0:18588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783947638.610438:0:18588:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783947638.610538:0:18588:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783947638.610545:0:18588:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783947638.631841:0:18588:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783947638.631959:0:18588:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.103@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783947638.631964:0:18588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783947638.631970:0:18588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947638.631971:0:18588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947638.631972:0:18588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947638.631973:0:18588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947638.631974:0:18588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947638.631976:0:18588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947638.631977:0:18588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947638.631978:0:18588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947638.631982:0:18588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783947638.631984:0:18588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947638.631985:0:18588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947638.631986:0:18588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947638.631987:0:18588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947638.631988:0:18588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947638.631989:0:18588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947638.631990:0:18588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947638.631991:0:18588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947638.631991:0:18588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783947638.632025:0:18588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783947638.632046:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236148992:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947638.632127:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.632174:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.632248:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236148992 00000100:00100000:0.0:1783947638.632255:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236148992 00000100:00100000:0.0:1783947638.632311:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783947638.632320:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:18588:x1870604236148992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783947638.632348:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783947638.632363:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783947638.632368:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783947638.632897:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:18588:x1870604236148992:12345-0@lo:253:mount.lustre.0 Request processed in 576us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.632905:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783947638.632995:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236148992:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783947638.633004:0:18588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783947638.633007:0:18588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947638.633008:0:18588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947638.633009:0:18588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947638.633010:0:18588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947638.633011:0:18588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947638.633012:0:18588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947638.633013:0:18588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947638.633014:0:18588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947638.633015:0:18588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783947638.633031:0:18588:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7bc7e0a000 from lustre-OST0000 10000000:01000000:2.0:1783947638.633056:0:18588:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783947638.633059:0:18588:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783947638.633066:0:18588:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7ac7798000 local copy 00010000:00010000:2.0:1783947638.633096:0:18588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947638.633191:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947638.633233:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.633265:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.633320:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236149120 00000100:00100000:0.0:1783947638.633325:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236149120 00000100:00100000:0.0:1783947638.633361:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947638.633368:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:18588:x1870604236149120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947638.633444:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:18588:x1870604236149120:12345-0@lo:501:mount.lustre.0 Request processed in 76us (210us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947638.633450:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783947638.633567:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6610000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149120:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783947638.633582:0:18588:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783947638.633606:0:18588:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783947638.633613:0:18588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.633622:0:18588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947638.633645:0:18588:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7bc7e0a000 10000000:01000000:1.0:1783947638.633649:0:18588:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783947638.633654:0:18588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783947638.633657:0:18588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947638.633661:0:18588:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783947638.633664:0:18588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783947638.633696:0:18588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.633704:0:18588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.633713:0:18588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947638.633725:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947638.633764:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947638.633780:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd2c12180 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.634444:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236149248 00000100:00100000:0.0:1783947638.634451:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236149248 00000100:00100000:0.0:1783947638.634520:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783947638.634528:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+18:18588:x1870604236149248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947638.634542:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947638.634567:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb5550149b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501494 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.634591:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb5550149b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501494 expref: 19 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.634617:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b800/0xe6fd1fdb5550149b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501494 expref: 19 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.634625:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b800, rc 0) 00000100:00100000:1.0:1783947638.634903:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947638.634927:0:18588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.634937:0:18588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947638.635212:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149248:12345-0@lo:101:mount.lustre.0 Request processed in 684us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.635219:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000040:00080000:1.0:1783947638.637292:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783947638.638253:0:18588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947638.641683:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783947638.641743:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783947638.642179:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783947638.642197:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783947638.642213:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783947638.642230:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783947638.642260:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783947638.642266:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783947638.642378:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947638.642823:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.642896:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683300 going to sleep for 11 seconds 00000100:00100000:1.0:1783947638.642939:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236149376 00000100:00100000:1.0:1783947638.642946:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236149376 00000100:00100000:1.0:1783947638.643032:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783947638.643042:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947638.643209:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149376:12345-0@lo:501:mount.lustre.0 Request processed in 169us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947638.643217:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783947638.643301:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947638.643340:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947638.643383:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.644089:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.644165:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236149504 00000100:00100000:0.0:1783947638.644170:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236149504 00000100:00100000:0.0:1783947638.644201:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783947638.644208:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947638.644998:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149504:12345-0@lo:503:mount.lustre.0 Request processed in 787us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.645007:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783947638.645200:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947638.645888:0:18588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947638.645976:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947638.646024:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.646113:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.646147:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236149632 00000100:00100000:0.0:1783947638.646153:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236149632 00000100:00100000:0.0:1783947638.646225:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783947638.646234:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947638.646894:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947638.647139:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783947638.647168:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783947638.647183:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783947638.647196:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783947638.647208:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783947638.647220:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783947638.647249:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783947638.647263:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783947638.647275:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1783947638.647287:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1783947638.647300:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1783947638.647324:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1783947638.647351:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947638.647389:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.647409:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149632:12345-0@lo:502:mount.lustre.0 Request processed in 513us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.647420:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783947638.648397:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac10b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.648617:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236149760 00000100:00100000:0.0:1783947638.648624:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236149760 00000100:00100000:0.0:1783947638.648653:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783947638.648660:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947638.648796:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149760:12345-0@lo:502:mount.lustre.0 Request processed in 135us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.648803:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783947638.648939:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947638.649009:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1783947638.649021:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1783947638.650043:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947638.650052:0:18605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783947638.650058:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.650060:0:18605:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783947638.650067:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947638.650093:0:18605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e7bc5514d40) 00000020:00000080:2.0:1783947638.650118:0:18605:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783947638.650125:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947638.650203:0:18605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bc7e0a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783947638.650212:0:18605:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947638.650219:0:18605:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe6fd1fdb555014a9 00010000:00010000:2.0:1783947638.654050:0:18605:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1783947638.654933:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1783947638.657141:0:18605:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783947638.659855:0:18605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783947638.659870:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947638.659877:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.659879:0:18605:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783947638.659884:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783947638.659888:0:18605:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1783947638.659889:0:18605:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947638.659891:0:18605:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783947638.659893:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783947638.659896:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.659904:0:18605:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783947638.659908:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947638.659911:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.659912:0:18605:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783947638.659915:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783947638.659917:0:18605:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783947638.659919:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947638.659922:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.659923:0:18605:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783947638.659925:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947638.659927:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.659928:0:18605:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783947638.659930:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783947638.659961:0:18605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947638.659964:0:18605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.659965:0:18605:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783947638.659968:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1783947638.661746:0:18588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1783947638.661796:0:18588:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783947638.661819:0:18588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.661832:0:18588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54400/0xe6fd1fdb55501494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550149b expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947638.664956:0:18588:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc7e0a000 from 1 10000000:01000000:2.0:1783947638.664964:0:18588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783947638.665002:0:18588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.665013:0:18588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.665024:0:18588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947638.665048:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947638.665121:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.665162:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783947638.665232:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236149888 00000100:00100000:1.0:1783947638.665239:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236149888 00000100:00100000:1.0:1783947638.665295:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783947638.665304:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:18588:x1870604236149888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947638.665326:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947638.665338:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555014b0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.665362:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.665372:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947638.665381:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55800, rc 0) 00000100:00100000:1.0:1783947638.665430:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236149888:12345-0@lo:101:mount.lustre.0 Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947638.665438:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783947638.666114:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236149888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947638.666144:0:18588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.666154:0:18588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947638.669953:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783947638.670250:0:18588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783947638.672920:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783947638.672996:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783947638.673022:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783947638.673028:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783947638.673142:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947638.673208:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.673251:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.673339:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150016 00000100:00100000:0.0:1783947638.673345:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150016 00000100:00100000:0.0:1783947638.673440:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783947638.673450:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947638.673813:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150016:12345-0@lo:501:mount.lustre.0 Request processed in 364us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.673821:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783947638.673922:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947638.673958:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947638.674006:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.674235:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac74f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783947638.674314:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150144 00000100:00100000:1.0:1783947638.674320:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150144 00000100:00100000:1.0:1783947638.674347:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783947638.674354:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947638.674452:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150144:12345-0@lo:503:mount.lustre.0 Request processed in 97us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947638.674477:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783947638.674815:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947638.675232:0:18588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947638.675304:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947638.675357:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.675494:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5f780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.675549:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150272 00000100:00100000:0.0:1783947638.675555:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150272 00000100:00100000:1.0:1783947638.675913:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783947638.675924:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947638.676031:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150272:12345-0@lo:502:mount.lustre.0 Request processed in 109us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947638.676037:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783947638.676891:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947638.677151:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783947638.677185:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783947638.677345:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783947638.677365:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783947638.677397:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783947638.677414:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783947638.677835:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783947638.677855:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1783947638.677870:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783947638.677884:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1783947638.677898:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1783947638.677939:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947638.678011:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.678114:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7c5f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783947638.678159:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150400 00000100:00100000:3.0:1783947638.678165:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150400 00000100:00100000:3.0:1783947638.678250:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783947638.678260:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947638.678385:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150400:12345-0@lo:502:mount.lustre.0 Request processed in 126us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947638.678392:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783947638.678499:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947638.678540:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1783947638.678549:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783947638.679377:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947638.679386:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.679388:0:18609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783947638.679395:0:18609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bc7e0a000 00000020:00000080:2.0:1783947638.679397:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947638.679404:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947638.679406:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.679407:0:18609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783947638.679409:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947638.679411:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.679412:0:18609:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783947638.679425:0:18609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7bc7e0a000 00000020:00000080:2.0:1783947638.679427:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947638.679646:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947638.679650:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.679659:0:18609:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783947638.681740:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947638.681765:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.681767:0:18609:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947638.681781:0:18609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bc7e0a000 00000020:00000080:2.0:1783947638.681784:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947638.681845:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947638.681849:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.681850:0:18609:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783947638.681853:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783947638.681856:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.681857:0:18609:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783947638.681860:0:18609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7bc7e0a000 00000020:00000080:2.0:1783947638.681862:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783947638.681898:0:18609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783947638.681901:0:18609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947638.681902:0:18609:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783947638.681905:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1783947638.684635:0:18588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783947638.684829:0:18588:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947638.684857:0:18588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.684869:0:18588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947638.684945:0:18588:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783947638.684948:0:18588:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7bc7e0a000 10000000:01000000:0.0:1783947638.684951:0:18588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7bc7e0a000 10000000:01000000:0.0:1783947638.684956:0:18588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783947638.684963:0:18588:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7bc7e0a000 from 1 10000000:01000000:0.0:1783947638.684965:0:18588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783947638.685003:0:18588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.685010:0:18588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.685020:0:18588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947638.685045:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783947638.685123:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.685162:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc32136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947638.685539:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150528 00000100:00100000:3.0:1783947638.685547:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150528 00000100:00100000:3.0:1783947638.685807:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783947638.685818:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:18588:x1870604236150528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947638.685833:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947638.685849:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e51400/0xe6fd1fdb555014c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555014be expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947638.685872:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e51400/0xe6fd1fdb555014c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555014be expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947638.685883:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e51400/0xe6fd1fdb555014c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555014be expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947638.685904:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51400, rc 0) 00000100:00100000:3.0:1783947638.685945:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236150528:12345-0@lo:101:mount.lustre.0 Request processed in 130us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947638.685951:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783947638.686088:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947638.686102:0:18588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.686111:0:18588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947638.688518:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1783947638.689194:0:18588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947638.689403:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783947638.691871:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783947638.691896:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783947638.691910:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783947638.691923:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783947638.691936:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783947638.691950:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783947638.691962:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783947638.691973:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783947638.691984:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783947638.691994:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783947638.692004:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783947638.692016:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783947638.692042:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783947638.692054:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783947638.692065:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783947638.692088:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783947638.692102:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783947638.692115:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783947638.692129:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783947638.692140:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783947638.692151:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783947638.692162:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783947638.692174:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783947638.692184:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1783947638.692194:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1783947638.692205:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1783947638.692215:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1783947638.692226:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1783947638.692247:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1783947638.692259:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1783947638.692269:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1783947638.692280:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1783947638.692290:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1783947638.692308:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1783947638.692319:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1783947638.692329:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1783947638.692348:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1783947638.692353:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1783947638.695521:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947638.695820:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.695873:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947638.697851:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150656 00000100:00100000:3.0:1783947638.697862:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150656 00000100:00100000:3.0:1783947638.697926:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783947638.697936:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236150656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783947638.698113:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236150656:12345-0@lo:501:mount.lustre.0 Request processed in 177us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947638.698121:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783947638.699021:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947638.699090:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947638.699146:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.699188:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213900 going to sleep for 11 seconds 00000100:00100000:1.0:1783947638.699244:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150784 00000100:00100000:1.0:1783947638.699256:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150784 00000100:00100000:1.0:1783947638.699304:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783947638.699313:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236150784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947638.699405:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236150784:12345-0@lo:503:mount.lustre.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947638.699411:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783947638.700823:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150784:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783947638.701262:0:18588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947638.701347:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947638.701410:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.705271:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc32136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.705754:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236150912 00000100:00100000:0.0:1783947638.705764:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236150912 00000100:00100000:0.0:1783947638.705828:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783947638.705838:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236150912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947638.706007:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236150912:12345-0@lo:502:mount.lustre.0 Request processed in 170us (4596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.706014:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783947638.706091:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236150912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947638.706312:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783947638.706350:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783947638.706366:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783947638.706377:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783947638.706388:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783947638.706416:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783947638.706449:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783947638.706483:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783947638.706499:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783947638.706511:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783947638.706523:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783947638.706534:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783947638.706546:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783947638.706558:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783947638.706572:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783947638.706585:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783947638.706597:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783947638.706609:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783947638.706622:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783947638.706636:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783947638.706649:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783947638.706802:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783947638.706819:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783947638.706831:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783947638.706843:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783947638.706856:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783947638.706870:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783947638.706882:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783947638.706896:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783947638.706908:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783947638.706920:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783947638.706932:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783947638.706945:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783947638.706956:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783947638.706981:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783947638.706994:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783947638.707007:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783947638.707033:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783947638.707049:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783947638.707062:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783947638.707088:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783947638.707105:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783947638.707118:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783947638.707132:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783947638.707145:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783947638.707159:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783947638.707172:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783947638.707185:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783947638.707233:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236151040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947638.707285:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.707321:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc32136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.708648:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151040 00000100:00100000:0.0:1783947638.708661:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151040 00000100:00100000:0.0:1783947638.708792:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783947638.708802:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236151040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947638.708953:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236151040:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.708961:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783947638.709027:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236151040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947638.709228:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1783947638.709251:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1783947638.709282:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236151168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947638.709316:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.709346:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151168 00000100:00100000:0.0:1783947638.709351:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151168 00000100:00100000:0.0:1783947638.709377:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783947638.709382:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236151168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947638.713399:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236151168:12345-0@lo:502:mount.lustre.0 Request processed in 4009us (4076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.713413:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783947638.713719:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc32136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.713744:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236151168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947638.713824:0:18588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1783947638.713838:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783947638.717790:0:18614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783947638.717806:0:18614:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e7c01b899c0) 00000020:00000080:0.0:1783947638.717831:0:18614:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1783947638.718003:0:18614:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bc7e0a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783947638.718007:0:18614:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc7e0a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783947638.718010:0:18614:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc7e0a000 3 00010000:00080000:0.0:1783947638.718043:0:18614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7be7a22800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1783947638.719760:0:18614:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1783947638.719878:0:18614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783947638.719923:0:18614:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783947638.719937:0:18614:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe6fd1fdb555014d3 00000100:00080000:0.0:1783947638.719947:0:18614:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947638.719953:0:18614:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e7be7a22800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947638.719985:0:18614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac85edf80 x1870604236151296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947638.720034:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236151296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783947638.720126:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.720191:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151296 00000100:00100000:0.0:1783947638.720197:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151296 00000100:00100000:0.0:1783947638.720225:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947638.720232:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1870604236151296:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783947638.720263:0:17088:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:0.0:1783947638.720298:0:17088:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe6fd1fdb555014da 00000004:00100000:0.0:1783947638.720313:0:17088:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783947638.720344:0:17088:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a27800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947638.720396:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1870604236151296:12345-0@lo:38:llog_process_th.0 Request processed in 163us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.720405:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783947638.720443:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac85edf80 x1870604236151296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947638.720453:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947638.720483:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783947638.720490:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783947638.720494:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783947638.720497:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a22800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947638.720503:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1870604236151296:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1783947638.720524:0:18614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783947638.720551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.720555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947638.720558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.720568:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947638.720593:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.720597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947638.720599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.720602:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783947638.720633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236151424:0@lo:400:kworker.0 00000100:00100000:0.0:1783947638.720660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.720680:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947638.720686:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236151552:0@lo:400:kworker.0 00000100:00100000:0.0:1783947638.720707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.720738:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151424 00000100:00100000:0.0:1783947638.720742:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151424 00000100:00100000:0.0:1783947638.720764:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151552 00000100:00100000:0.0:1783947638.720767:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151552 00000100:00100000:0.0:1783947638.720780:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947638.720787:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236151424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947638.725968:0:17089:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783947638.725984:0:17089:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783947638.725997:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783947638.726010:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947638.726024:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236151552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947638.726141:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236151552:12345-0@lo:400:kworker.0 Request processed in 121us (5432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947638.726149:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783947638.729881:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac85ef480 x1870604236151552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947638.729899:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236151552:0@lo:400:kworker.0 00000100:00100000:0.0:1783947638.730052:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236151424:12345-0@lo:400:kworker.0 Request processed in 9263us (9389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.730063:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000004:0.0:1783947638.730212:0:18614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783947638.730226:0:18614:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9e7c01b8b380) 00000020:00000080:0.0:1783947638.730249:0:18614:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1783947638.730408:0:18614:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7bc7e0a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783947638.730412:0:18614:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7bc7e0a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783947638.730414:0:18614:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7bc7e0a000 3 00010000:00080000:0.0:1783947638.730452:0:18614:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7be7a23800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.103@tcp at head 00010000:00080000:1.0:1783947638.730684:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac85edf80 x1870604236151424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947638.730694:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236151424:0@lo:400:kworker.0 00010000:00010000:0.0:1783947638.736381:0:18614:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1783947638.739547:0:18614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1783947638.739612:0:18614:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783947638.739624:0:18614:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xe6fd1fdb555014e8 00000100:00080000:0.0:1783947638.739634:0:18614:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947638.739639:0:18614:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9e7be7a23800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947638.739676:0:18614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7fd0700 x1870604236151680/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783947638.739711:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236151680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783947638.739780:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947638.739830:0:18614:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783947638.739849:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.739853:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947638.739856:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.739858:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947638.739862:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.739864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783947638.739867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947638.739869:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947638.740269:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151680 00000100:00100000:3.0:1783947638.740277:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151680 00000100:00100000:3.0:1783947638.740314:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783947638.740321:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1870604236151680:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783947638.740346:0:17088:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1783947638.740386:0:17088:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xe6fd1fdb555014ef 00000004:00100000:3.0:1783947638.740399:0:17088:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947638.740506:0:17088:0:(import.c:65:import_set_state_nolock()) ffff9e7bc51b1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947638.740627:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1870604236151680:12345-0@lo:38:llog_process_th.0 Request processed in 305us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947638.740635:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783947638.741116:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e7ac7fd0700 x1870604236151680/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947638.741128:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947638.741138:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783947638.741151:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783947638.741155:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783947638.741158:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a23800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783947638.741163:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1870604236151680:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783947638.741287:0:18614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1783947638.741494:0:18588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783947638.741529:0:18588:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783947638.741549:0:18588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.741754:0:18588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9a800/0xe6fd1fdb555014be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555014c5 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783947638.741807:0:18588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783947638.741810:0:18588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947638.741811:0:18588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947638.741812:0:18588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947638.741813:0:18588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947638.741814:0:18588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947638.741816:0:18588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947638.741817:0:18588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947638.741819:0:18588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947638.741822:0:18588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783947638.741825:0:18588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783947638.741826:0:18588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783947638.741827:0:18588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947638.741828:0:18588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947638.741829:0:18588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947638.741830:0:18588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947638.741831:0:18588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947638.741832:0:18588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947638.741833:0:18588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783947638.741852:0:18588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783947638.741868:0:18588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236151808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783947638.741919:0:18588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.741946:0:18588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947638.742008:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151808 00000100:00100000:0.0:1783947638.742014:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151808 00000100:00100000:0.0:1783947638.742048:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783947638.742055:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:18588:x1870604236151808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783947638.742090:0:17081:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783947638.742106:0:17081:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783947638.746824:0:17081:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783947638.746841:0:17081:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783947638.746889:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783947638.746894:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783947638.746916:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.746936:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.746944:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.746952:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.746993:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.747018:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 21 pid: 17082 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947638.747035:0:17103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236151936:0@lo:104: 00000100:00100000:0.0:1783947638.747123:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947638.747175:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.747183:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 21 pid: 17080 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947638.747192:0:17103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236152064:0@lo:104: 00000100:00100000:0.0:1783947638.747218:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947638.747234:0:17103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213900 going to sleep for 11 seconds 00000100:00100000:2.0:1783947638.747408:0:17070:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783947638.747517:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236151936 00000100:00100000:2.0:1783947638.747525:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236151936 00000100:00100000:2.0:1783947638.748536:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152064 00000100:00100000:2.0:1783947638.748544:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152064 00000100:00100000:2.0:1783947638.748646:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947638.748656:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:17103:x1870604236151936:12345-0@lo:104: 00010000:00010000:2.0:1783947638.748747:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.748834:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947638.748841:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:17103:x1870604236151936:12345-0@lo:104: Request processed in 187us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947638.748848:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783947638.748867:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947638.748874:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc5debc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236152064:12345-0@lo:104: 00010000:00010000:2.0:1783947638.748881:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.748913:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947638.748918:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc5debc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236152064:12345-0@lo:104: Request processed in 45us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947638.748924:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1783947638.748972:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947638.748978:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.748986:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55600 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947638.748990:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.748998:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947638.749006:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947638.749012:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947638.749054:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749061:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947638.749103:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749111:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb55501447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550144e expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749127:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947638.749130:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749136:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55e00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947638.749139:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749145:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947638.749151:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947638.749156:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947638.749169:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749175:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947638.749181:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749197:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55e00/0xe6fd1fdb55501439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501440 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.749209:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947638.749211:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947638.749212:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947638.749231:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236152192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947638.749263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.749298:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947638.749304:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236152320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947638.749328:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947638.749358:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152192 00000100:00100000:2.0:1783947638.749362:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152192 00010000:00010000:2.0:1783947638.749380:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 22 pid: 17082 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947638.749401:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152320 00000100:00100000:2.0:1783947638.749404:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152320 00010000:00010000:2.0:1783947638.749415:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 23 pid: 17080 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947638.749822:0:17103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236151936:0@lo:104: 00000100:00100000:0.0:1783947638.749833:0:17103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236152064:0@lo:104: 00010000:00010000:0.0:1783947638.749852:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.749868:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947638.749950:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:18588:x1870604236151808:12345-0@lo:253:mount.lustre.0 Request processed in 7894us (8030us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.749960:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783947638.750576:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947638.750587:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:3637:x1870604236152192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947638.750599:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947638.750616:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 22 pid: 17082 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.750627:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 22 pid: 17082 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.750644:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb5550144e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501447 expref: 22 pid: 17082 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.750656:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947638.750848:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3637:x1870604236152192:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947638.750855:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783947638.750902:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236152192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947638.750988:0:18588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:18588:1870604236151808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783947638.750999:0:18588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783947638.751001:0:18588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783947638.751003:0:18588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783947638.751004:0:18588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783947638.751005:0:18588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783947638.751006:0:18588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783947638.751007:0:18588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783947638.751009:0:18588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783947638.751010:0:18588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783947638.751011:0:18588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783947638.751022:0:18588:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783947638.751625:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783947638.751635:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bff94b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:3637:x1870604236152320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947638.751645:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947638.751651:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 20 pid: 17080 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751661:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 20 pid: 17080 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751796:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846ac00/0xe6fd1fdb55501440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501439 expref: 20 pid: 17080 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751809:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751816:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783947638.751832:0:17074:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012079822s 00010000:00010000:2.0:1783947638.751836:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751843:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751851:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751857:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751863:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947638.751867:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.751874:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.763641:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947638.763661:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.764882:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.764905:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b600/0xe6fd1fdb555014f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947638.764926:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:0.0:1783947638.767718:0:18588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1783947638.773412:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bff94b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:3637:x1870604236152320:12345-0@lo:103:ldlm_bl.0 Request processed in 21771us (24074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947638.773522:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236152320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947638.773641:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:3.0:1783947638.776570:0:18588:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783947638.776580:0:18588:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783947638.776616:0:18588:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783947638.776660:0:18588:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783947638.776844:0:18588:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783947638.776870:0:18588:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1783947638.784637:0:18588:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947638.784964:0:18588:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783947639.541858:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783947639.899132:0:18669:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947639.899412:0:18669:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947640.566059:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783947640.698327:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947640.698334:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bff95d000 from 9 10000000:01000000:3.0:1783947640.698339:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947640.698384:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947640.698397:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947640.698408:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947640.698439:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947640.699277:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947640.699395:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152448 00000100:00100000:1.0:1783947640.699404:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152448 00000100:00100000:1.0:1783947640.699499:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783947640.699510:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+19:17085:x1870604236152448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947640.700256:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947640.700279:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555014fd expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947640.700308:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 20 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947640.700318:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 20 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947640.700327:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55c00, rc 0) 00000100:00100000:1.0:1783947640.700375:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:17085:x1870604236152448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 867us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947640.700383:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783947640.700437:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0180 going to sleep for 11 seconds 00000100:00100000:1.0:1783947640.700485:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947640.700501:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947640.700511:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947640.700904:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783947640.700945:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947640.701294:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc32136c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947640.707254:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152576 00000100:00100000:2.0:1783947640.707271:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152576 00000100:00100000:0.0:1783947640.707420:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783947640.707430:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:17085:x1870604236152576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783947640.707511:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783947640.708172:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783947640.708178:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1783947640.708339:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:17085:x1870604236152576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 908us (7391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947640.708360:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783947640.708451:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783947640.708556:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783947640.708566:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947640.708577:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947640.708587:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783947640.708594:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7ac7ff8000 from 9 10000000:01000000:3.0:1783947640.708597:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783947640.708629:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947640.708637:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947640.708645:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947640.708667:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947640.708714:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947640.711275:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783947640.715711:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152704 00000100:00100000:2.0:1783947640.715727:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152704 00000100:00100000:2.0:1783947640.715922:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947640.715933:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:17085:x1870604236152704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947640.715951:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947640.715970:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550150b expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947640.715999:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947640.716011:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947640.716020:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:2.0:1783947640.716121:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236152704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (7406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947640.716129:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783947640.716274:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947640.716293:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947640.716314:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947640.716378:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783947640.716416:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947640.716444:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1783947640.716479:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152832 00000100:00100000:2.0:1783947640.716483:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152832 00000100:00100000:2.0:1783947640.716502:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783947640.716508:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236152832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783947640.717237:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783947640.717259:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783947640.717262:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1783947640.717345:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236152832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 835us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947640.717355:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783947640.717399:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236152832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783947640.717479:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947640.717487:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947640.717497:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947641.017874:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783947641.588321:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947642.611768:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947643.125725:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947643.125755:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236152960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947643.125835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947643.132203:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236153088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947643.132273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947643.132406:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236152960 00000100:00100000:2.0:1783947643.132421:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236152960 00000100:00100000:2.0:1783947643.132482:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153088 00000100:00100000:2.0:1783947643.132485:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153088 00000100:00100000:2.0:1783947643.132503:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947643.132511:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236152960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947643.132550:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783947643.132613:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236152960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (6778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947643.132621:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947643.132638:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947643.132645:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236153088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947643.132663:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783947643.132690:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236153088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947643.132696:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947643.132803:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236153088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947643.132819:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236152960:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783947643.643715:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783947644.025103:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783947644.148878:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236153216:0@lo:400:kworker.0 00000100:00100000:1.0:1783947644.148951:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947644.149352:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153216 00000100:00100000:2.0:1783947644.149361:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153216 00000100:00100000:2.0:1783947644.149417:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783947644.149427:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3637:x1870604236153216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783947644.150103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947644.150109:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947644.150112:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947644.150115:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947644.150149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947644.150153:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947644.150163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947644.150166:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947644.150209:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236153344:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.150255:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.150284:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236153856:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.150310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.150329:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947644.150335:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236153728:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.150356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947644.150920:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3637:x1870604236153216:12345-0@lo:400:kworker.0 Request processed in 1491us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947644.150932:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783947644.152274:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3637:1870604236153216:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.152596:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236153472:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.152651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.152676:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236153984:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.152701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.152724:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947644.152730:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236153600:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.152756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947644.152794:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153344 00000100:00100000:3.0:1783947644.152800:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153344 00000100:00100000:3.0:1783947644.152831:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153600 00000100:00100000:3.0:1783947644.152834:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153600 00000100:00100000:3.0:1783947644.152848:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947644.152855:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236153344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.152912:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236153344:12345-0@lo:400:kworker.0 Request processed in 57us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.152919:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947644.152945:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947644.152951:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236153600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.152998:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236153600:12345-0@lo:400:kworker.0 Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.153006:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947644.153023:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153856 00000100:00100000:3.0:1783947644.153027:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153856 00000100:00100000:3.0:1783947644.153062:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153728 00000100:00100000:3.0:1783947644.153065:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153728 00000100:00100000:3.0:1783947644.153074:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153472 00000100:00100000:3.0:1783947644.153076:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153472 00000100:00100000:3.0:1783947644.153085:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236153984 00000100:00100000:3.0:1783947644.153087:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236153984 00000100:00100000:3.0:1783947644.153100:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947644.153106:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236153856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.153137:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236153856:12345-0@lo:400:kworker.0 Request processed in 30us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.153143:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947644.153155:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947644.153160:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236153728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.153188:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236153728:12345-0@lo:400:kworker.0 Request processed in 27us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.153193:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947644.153204:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947644.153209:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236153472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.153234:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236153472:12345-0@lo:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.153248:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783947644.153260:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783947644.153265:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236153984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.153292:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236153984:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947644.153297:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783947644.153337:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c93800 x1870604236153728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947644.153350:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236153728:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.153361:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236153344:0@lo:400:kworker.0 00010000:00080000:3.0:1783947644.153371:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c90000 x1870604236153856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947644.153379:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236153856:0@lo:400:kworker.0 00000100:00100000:3.0:1783947644.153410:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236153600:0@lo:400:kworker.0 00010000:00080000:3.0:1783947644.153419:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c93100 x1870604236153472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947644.153427:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236153472:0@lo:400:kworker.0 00010000:00080000:3.0:1783947644.153436:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c91500 x1870604236153984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947644.153443:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236153984:0@lo:400:kworker.0 00000100:00080000:2.0:1783947644.153689:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947644.153694:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783947644.661332:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947645.687912:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783947645.849735:0:18959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783947646.713487:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783947646.713661:0:19011:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947646.714056:0:19011:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1783947647.667437:0:19061:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947647.668026:0:19061:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783947647.731879:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947647.988334:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947632/real 1783947632] req@ffff9e7ac85eca80 x1870604236147456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947647.988388:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac85eca80 x1870604236147456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947647.988398:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947632/real 1783947632] req@ffff9e7ac85ed180 x1870604236147584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947647.988408:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac85ed180 x1870604236147584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783947647.988428:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5586000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947647.988558:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783947647.988562:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236147456:0@lo:8:kworker.0 00000100:00080000:0.0:1783947647.988575:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947647.991555:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:3.0:1783947647.991592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947647.991598:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947647.991601:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947647.991603:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947647.991617:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947647.991620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783947647.991624:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5586000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947647.991630:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:3.0:1783947647.991635:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1783947647.991639:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236147584:0@lo:8:kworker.0 00000100:00080000:3.0:1783947647.991644:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9e7bc5586000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947647.991668:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c92300 x1870604236154624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947647.991687:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947647.991690:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783947647.991692:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783947647.991695:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:3.0:1783947647.991698:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1783947647.991704:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236154624:0@lo:8:kworker.0 00000100:00080000:3.0:1783947647.991716:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bd1b69800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:3.0:1783947647.991732:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c93800 x1870604236154752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783947647.991777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1783947647.991781:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783947647.991783:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783947647.991798:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783947647.991801:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783947647.991822:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236154496:0@lo:400:kworker.0 00000100:00100000:3.0:1783947647.991857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947647.991940:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236154752:0@lo:8:kworker.0 00000100:00100000:0.0:1783947647.991965:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947647.992001:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236154368:0@lo:400:kworker.0 00000100:00100000:0.0:1783947647.992025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947647.992052:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236155136:0@lo:400:kworker.0 00000100:00100000:0.0:1783947647.992073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947647.992089:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783947647.992095:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236154240:0@lo:400:kworker.0 00000100:00100000:0.0:1783947647.992116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947647.992132:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236155008:0@lo:400:kworker.0 00000100:00100000:0.0:1783947647.992148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947647.992184:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236154368 00000100:00100000:0.0:1783947647.992191:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236154368 00000100:00100000:0.0:1783947647.992235:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155136 00000100:00100000:0.0:1783947647.992238:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155136 00000100:00100000:1.0:1783947647.992257:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236154624 00000100:00100000:1.0:1783947647.992263:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236154624 00000100:00100000:1.0:1783947647.992283:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236154752 00000100:00100000:1.0:1783947647.992286:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236154752 00000100:00100000:1.0:1783947647.992300:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783947647.992307:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236154624:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783947647.992335:0:18593:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1783947647.992361:0:18593:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb55501519 00002000:00100000:1.0:1783947647.992374:0:18593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9e7be78ba800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1783947647.992378:0:18593:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1783947647.992381:0:18593:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783947647.992588:0:18593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1783947647.992614:0:18593:0:(import.c:65:import_set_state_nolock()) ffff9e7be78bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947647.992622:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155008 00000100:00100000:0.0:1783947647.992626:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155008 00000100:00100000:0.0:1783947647.992643:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783947647.992651:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236154368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947647.992673:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604236154624:12345-0@lo:8:kworker.0 Request processed in 365us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947647.992683:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947647.992698:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236154368:12345-0@lo:400:kworker.0 Request processed in 47us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947647.992706:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947647.992712:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947647.992719:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236154752:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783947647.992724:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947647.992731:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236155136:12345-0@lo:400:kworker.0 00010000:00020000:1.0:1783947647.992735:0:18593:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783947647.992759:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236155136:12345-0@lo:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947647.992768:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783947647.992780:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947647.992786:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236155008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947647.992810:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236155008:12345-0@lo:400:kworker.0 Request processed in 24us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947647.992836:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947647.992861:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236154496 00000100:00100000:0.0:1783947647.992865:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236154496 00000100:00100000:0.0:1783947647.992882:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236154240 00000100:00100000:0.0:1783947647.992884:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236154240 00000100:00100000:0.0:1783947647.992904:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947647.992911:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236154496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947647.992942:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236154496:12345-0@lo:400:kworker.0 Request processed in 32us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947647.992948:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947647.992960:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783947647.992966:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236154240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947647.992991:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236154240:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947647.992997:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1783947647.993017:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947647.993020:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783947647.993046:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236154240:0@lo:400:kworker.0 00010000:00080000:0.0:1783947647.993059:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc9429180 x1870604236155008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947647.993069:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236155008:0@lo:400:kworker.0 00010000:00080000:0.0:1783947647.993079:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c90e00 x1870604236154368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947647.993088:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236154368:0@lo:400:kworker.0 00010000:00080000:0.0:1783947647.993098:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bc9428700 x1870604236155136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947647.993112:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236155136:0@lo:400:kworker.0 00010000:00080000:0.0:1783947647.993150:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c92300 x1870604236154624/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947647.993158:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783947647.993164:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783947647.993173:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783947647.993179:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783947647.993181:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc5586000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783947647.993193:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783947647.993198:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236154624:0@lo:8:kworker.0 00000004:00080000:0.0:1783947647.993215:0:17828:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783947647.993295:0:17828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 533220837429ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783947647.993301:0:17828:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1783947647.994137:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236154112:0@lo:400:kworker.0 00000100:00100000:2.0:1783947647.994188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947647.994235:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236154880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947647.994259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783947647.994327:0:17829:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783947647.994346:0:17829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17829:1870604236155392:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1783947647.994371:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947647.994387:0:17829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947647.994404:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783947647.994410:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783947647.994443:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236154112 00000100:00100000:0.0:1783947647.994451:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236154112 00000100:00100000:0.0:1783947647.994529:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783947647.994537:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3640:x1870604236154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947647.994540:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947647.994550:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac6612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236155264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947648.000342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947648.000523:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236154496:0@lo:400:kworker.0 00000100:00100000:3.0:1783947648.000585:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236154880 00000100:00100000:3.0:1783947648.000592:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236154880 00000100:00100000:3.0:1783947648.000639:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947648.000649:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3640:x1870604236154112:12345-0@lo:400:kworker.0 Request processed in 6109us (6456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947648.000650:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236154880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947648.000667:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783947648.000708:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236154880:12345-0@lo:400:kworker.0 Request processed in 60us (6447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947648.000715:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947648.000800:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155392 00000100:00100000:3.0:1783947648.000804:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155392 00000100:00100000:3.0:1783947648.000942:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783947648.000949:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17829:x1870604236155392:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1783947648.001136:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947648.001179:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236154112:0@lo:400:kworker.0 00000100:00100000:0.0:1783947648.001183:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155264 00000100:00100000:0.0:1783947648.001189:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155264 00010000:00080000:3.0:1783947648.001199:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c90a80 x1870604236154880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947648.001211:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236154880:0@lo:400:kworker.0 00000100:00100000:0.0:1783947648.001220:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783947648.001230:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870604236155264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783947648.001508:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783947648.001558:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870604236155264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 330us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947648.001566:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1783947648.007833:0:17820:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:2.0:1783947648.008071:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6612d80 x1870604236155264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947648.008098:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236155264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947648.019258:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236154752:12345-0@lo:8:kworker.0 Request processed in 26530us (27283us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783947648.019274:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783947648.019369:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783947648.019377:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783947648.019382:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236154752:0@lo:8:kworker.0 00002000:00080000:0.0:1783947648.031683:0:19073:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783947648.031695:0:19073:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783947648.031801:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17829:x1870604236155392:12345-0@lo:7:osp-pre-0-1.0 Request processed in 30848us (37423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947648.031820:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783947648.031862:0:17829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac6613480 x1870604236155392/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947663 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947648.031881:0:17829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac6613480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17829:1870604236155392:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1783947648.031905:0:17829:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783947648.031950:0:17829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17829:1870604236155520:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783947648.031989:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947648.032026:0:17829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947648.032222:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155520 00000100:00100000:0.0:1783947648.032230:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155520 00000100:00100000:0.0:1783947648.032286:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783947648.032295:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17829:x1870604236155520:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783947648.032320:0:18595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1783947648.032356:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17829:x1870604236155520:12345-0@lo:5:osp-pre-0-1.0 Request processed in 63us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947648.032364:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783947648.032438:0:17829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68700 x1870604236155520/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947664 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947648.032449:0:17829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17829:1870604236155520:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783947648.032486:0:17829:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783947648.032516:0:17829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17829:1870604236155648:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783947648.032542:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947648.032561:0:17829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947648.032717:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155648 00000100:00100000:0.0:1783947648.032722:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155648 00000100:00100000:0.0:1783947648.032755:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783947648.032764:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17829:x1870604236155648:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783947648.032790:0:18593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1783947648.087399:0:18589:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1783947648.087416:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783947648.088309:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17829:x1870604236155648:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55540us (55759us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783947648.088322:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783947648.088377:0:17829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68700 x1870604236155648/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947664 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947648.088402:0:17829:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783947648.088410:0:17829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17829:1870604236155648:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783947648.088426:0:17829:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1783947648.088507:0:17829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17829:1870604236155776:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783947648.088543:0:17829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947648.088566:0:17829:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783947648.088601:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155776 00000100:00100000:1.0:1783947648.088607:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155776 00000100:00100000:1.0:1783947648.088644:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783947648.088653:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17829:x1870604236155776:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783947648.088698:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17829:x1870604236155776:12345-0@lo:900:osp-pre-0-1.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947648.088704:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783947648.088732:0:17829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68700 x1870604236155776/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947664 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947648.088742:0:17829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17829:1870604236155776:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1783947648.243654:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236155904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947648.243735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947648.243806:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236155904 00000100:00100000:3.0:1783947648.243814:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236155904 00000100:00100000:3.0:1783947648.243860:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947648.243868:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236155904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947648.243920:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947648.244210:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236156032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947648.246824:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236155904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947648.251556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947648.251689:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1783947648.251700:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1783947648.252214:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236155904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8341us (8473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947648.252226:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783947648.252256:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156032 00000100:00100000:3.0:1783947648.252264:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156032 00000100:00100000:3.0:1783947648.252292:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947648.252298:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236156032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783947648.252333:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783947648.252390:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236156032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947648.252396:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783947648.252602:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236156032:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783947648.755708:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947649.779586:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947650.807519:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783947651.252117:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947651.838114:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947652.853956:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947653.107713:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947633/real 1783947633] req@ffff9e7ac85ed880 x1870604236148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947653 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947653.107747:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac85ed880 x1870604236148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947653 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947653.107758:0:3636:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783947633/real 1783947633] req@ffff9e7ac85ed500 x1870604236148224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947653 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947653.107806:0:3636:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e7ac85ed500 x1870604236148224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783947653 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783947653.107826:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947653.107854:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947653.107858:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236148096:0@lo:8:kworker.0 00000100:00080000:3.0:1783947653.107864:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947653.107870:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783947653.107873:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236148224:0@lo:8:kworker.0 00000100:00080000:0.0:1783947653.108052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947653.108056:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783947653.108059:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947653.108064:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:0.0:1783947653.108069:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783947653.108075:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e7bd10ba800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947653.108098:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7fd2a00 x1870604236156416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947653.108110:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947653.108113:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783947653.108115:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947653.108118:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:0.0:1783947653.108120:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783947653.108124:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7bc47c4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947653.108135:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7fd2680 x1870604236156544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783947653.108160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783947653.108163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783947653.108165:0:37:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783947653.108168:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1783947653.108171:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783947653.108174:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bd1b69800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947653.108195:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7fd3b80 x1870604236157056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947653.108301:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236156160:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108432:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236156928:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108514:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783947653.108520:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236156800:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108564:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236157440:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108621:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236156672:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108662:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236157312:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108717:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783947653.108723:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236156288:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108761:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236157184:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947653.108821:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156928 00000100:00100000:2.0:1783947653.108829:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156928 00000100:00100000:2.0:1783947653.108884:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947653.108893:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236156928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.108944:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236156928:12345-0@lo:400:kworker.0 Request processed in 52us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947653.108951:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783947653.108973:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156800 00000100:00100000:2.0:1783947653.108977:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156800 00000100:00100000:2.0:1783947653.109000:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156288 00000100:00100000:2.0:1783947653.109003:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156288 00000100:00100000:2.0:1783947653.109017:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947653.109023:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236156800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.109055:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236156800:12345-0@lo:400:kworker.0 Request processed in 32us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947653.109062:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783947653.109074:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947653.109080:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236156288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.109120:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236156288:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947653.109126:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783947653.109145:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157440 00000100:00100000:2.0:1783947653.109148:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157440 00000100:00100000:2.0:1783947653.109167:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156672 00000100:00100000:2.0:1783947653.109170:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156672 00000100:00100000:2.0:1783947653.109179:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157312 00000100:00100000:2.0:1783947653.109181:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157312 00000100:00100000:2.0:1783947653.109192:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157184 00000100:00100000:2.0:1783947653.109194:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157184 00000100:00100000:2.0:1783947653.109207:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947653.109214:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236157440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.109245:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236157440:12345-0@lo:400:kworker.0 Request processed in 31us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947653.109250:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783947653.109262:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947653.109268:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236156672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.109292:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236156672:12345-0@lo:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947653.109298:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783947653.109309:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947653.109314:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236157312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.109338:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236157312:12345-0@lo:400:kworker.0 Request processed in 24us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947653.109344:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947653.109354:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783947653.109367:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236157184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.109397:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236157184:12345-0@lo:400:kworker.0 Request processed in 31us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947653.109403:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783947653.109434:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947653.109438:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947653.109441:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947653.109499:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236156288:0@lo:400:kworker.0 00010000:00080000:2.0:1783947653.109511:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c93800 x1870604236157184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947653.109521:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236157184:0@lo:400:kworker.0 00010000:00080000:2.0:1783947653.109530:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7fd3480 x1870604236156672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947653.109538:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236156672:0@lo:400:kworker.0 00010000:00080000:2.0:1783947653.109548:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c90a80 x1870604236157312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947653.109555:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236157312:0@lo:400:kworker.0 00000100:00100000:2.0:1783947653.109587:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236156800:0@lo:400:kworker.0 00010000:00080000:2.0:1783947653.109598:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c91500 x1870604236157440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947653.109605:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236157440:0@lo:400:kworker.0 00010000:00080000:2.0:1783947653.109616:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7fd2d80 x1870604236156928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783947669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947653.109636:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236156928:0@lo:400:kworker.0 00000100:00100000:3.0:1783947653.110511:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236156416:0@lo:8:kworker.0 00000100:00100000:3.0:1783947653.110567:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947653.110601:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236156544:0@lo:8:kworker.0 00000100:00100000:3.0:1783947653.110627:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947653.110643:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236157056:0@lo:8:kworker.0 00000100:00100000:3.0:1783947653.110666:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947653.110699:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156416 00000100:00100000:3.0:1783947653.110705:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156416 00000100:00100000:3.0:1783947653.110728:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156544 00000100:00100000:3.0:1783947653.110731:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156544 00000100:00100000:3.0:1783947653.110739:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157056 00000100:00100000:3.0:1783947653.110741:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157056 00000100:00100000:3.0:1783947653.110752:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947653.110757:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236156416:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1783947653.110785:0:18595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1783947653.110828:0:18595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501520 00002000:00100000:3.0:1783947653.110852:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e7bf34cd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783947653.110856:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783947653.110859:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783947653.110940:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783947653.110965:0:18595:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947653.111011:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604236156416:12345-0@lo:8:kworker.0 Request processed in 252us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947653.111018:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947653.111033:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947653.111037:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236156544:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783947653.111047:0:18595:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783947653.111389:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947653.111397:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236157056:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783947653.111408:0:18593:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783947653.111439:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1870604236157056:12345-0@lo:8:kworker.0 Request processed in 42us (771us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783947653.111479:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783947653.113592:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236156160 00000100:00100000:0.0:1783947653.113604:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236156160 00000100:00100000:0.0:1783947653.113658:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783947653.113668:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3638:x1870604236156160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947653.113751:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:3638:x1870604236156160:12345-0@lo:400:kworker.0 Request processed in 85us (5374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947653.113758:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783947653.113847:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236156160:0@lo:400:kworker.0 00010000:00080000:2.0:1783947653.117561:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7fd2a00 x1870604236156416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947653.117578:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947653.117587:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783947653.117597:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783947653.117603:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783947653.117606:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd10ba800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783947653.117634:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783947653.117641:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236156416:0@lo:8:kworker.0 00000100:00080000:2.0:1783947653.117659:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783947653.117663:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783947653.117666:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236157056:0@lo:8:kworker.0 00000004:00080000:0.0:1783947653.118874:0:17112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1783947653.118905:0:17112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1870604236157696:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783947653.118974:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947653.119003:0:17112:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8c94f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783947653.119020:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947653.119030:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236157568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947653.119053:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947653.119085:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157696 00000100:00100000:0.0:1783947653.119092:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157696 00000100:00100000:0.0:1783947653.119147:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947653.119156:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17112:x1870604236157696:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783947653.119406:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157568 00000100:00100000:0.0:1783947653.119411:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157568 00000100:00100000:0.0:1783947653.119437:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783947653.119443:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236157568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783947653.119479:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783947653.119531:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1870604236157568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947653.119538:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783947653.119574:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783947653.119602:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c90000 x1870604236157568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947653.119619:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236157568:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1783947653.119658:0:17111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783947653.119748:0:17111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 538347290607ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783947653.119755:0:17111:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1783947653.123935:0:17067:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1783947653.125129:0:18593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1783947653.125142:0:18593:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1783947653.125150:0:18593:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:3.0:1783947653.149517:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236156544:12345-0@lo:8:kworker.0 Request processed in 38471us (38882us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783947653.149533:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783947653.149607:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947653.149613:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783947653.149617:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236156544:0@lo:8:kworker.0 00002000:00010000:0.0:1783947653.180331:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947653.180346:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.180365:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1783947653.180370:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947653.180377:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.180392:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.180402:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.180424:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.180449:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947653.180509:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947653.180517:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.180526:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947653.180531:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.180539:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.180570:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.180577:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb55501527 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.180603:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.180606:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.180608:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783947653.193977:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783947653.193994:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.194012:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1783947653.194017:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783947653.194023:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.194040:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.194052:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.194061:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.194140:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947653.201046:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947653.201061:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.201080:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1783947653.201084:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947653.201089:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.201104:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.201115:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.201122:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201478:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947653.201486:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201495:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.201499:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201509:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201536:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201543:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002356346f/0xe6fd1fdb5550152e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201559:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.201562:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201569:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ae00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.201572:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201900:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.201914:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.201979:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.201982:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.201984:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947653.202031:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783947653.202038:0:18593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501535 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.202311:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947653.202855:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947653.202863:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.202875:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1783947653.202879:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947653.202885:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.202896:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.202905:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.202913:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.202965:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947653.205332:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947653.205346:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.205362:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1783947653.205367:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947653.205382:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.205397:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.205407:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.205415:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205658:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947653.205666:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205675:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947653.205679:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205689:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205706:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205726:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000609bbc/0xe6fd1fdb5550153c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205740:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947653.205743:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205749:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947653.205752:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205759:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205768:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.205774:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.205776:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.205777:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947653.210329:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783947653.210346:0:18593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008828f7f3/0xe6fd1fdb55501543 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.210712:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947653.214135:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947653.214150:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.214169:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1783947653.214174:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947653.214180:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.214194:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.214223:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.214230:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.214256:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.214544:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.214552:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.214561:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.214566:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.214581:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.214598:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.214605:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654422fd/0xe6fd1fdb5550154a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.214624:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.214626:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.214628:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947653.217735:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947653.217749:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.217765:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1783947653.217769:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947653.217775:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.217789:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.217811:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.217819:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.217891:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947653.218657:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.218666:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.218676:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.218686:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.218697:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.218714:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.218722:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2c7b677/0xe6fd1fdb55501551 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.218743:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.218745:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.218746:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947653.220986:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947653.221000:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.221016:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1783947653.221020:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947653.221026:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.221038:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.221047:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.221054:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947653.221231:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.221775:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.221783:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.221801:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9ae00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.221806:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.221816:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.221833:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.221853:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83ee4ae/0xe6fd1fdb55501558 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.221869:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.221870:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.221872:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.221977:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.221985:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.221995:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.222006:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.222011:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222022:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222032:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222039:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222060:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947653.222129:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.222136:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.222145:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.222149:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.222156:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.222168:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.222182:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c85f311c/0xe6fd1fdb5550155f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.222196:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.222198:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.222200:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.222406:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.222412:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222421:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.222424:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.222429:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222438:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222448:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222479:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222495:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.222538:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.222543:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.222548:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ac00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.222551:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.222556:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.222564:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.222568:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000454e20ed/0xe6fd1fdb55501566 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.222577:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.222639:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.222642:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.222951:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.222958:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222966:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.222969:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.222973:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222981:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222989:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.222996:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223017:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947653.223111:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.223117:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.223125:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846a800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.223129:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.223137:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.223147:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.223153:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8157ad/0xe6fd1fdb5550156d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.223167:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.223169:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.223170:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.223321:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.223327:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223342:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.223344:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.223348:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223358:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223366:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223373:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223394:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.223751:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.223757:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.223765:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846be00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.223769:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.223777:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.223789:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.223808:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003057bf7c/0xe6fd1fdb55501574 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.223822:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.223824:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.223825:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.223912:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.223919:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223928:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.223931:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.223934:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223943:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223962:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223968:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.223989:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947653.224110:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.224116:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.224123:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ba00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.224127:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.224135:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.224145:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.224152:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cee70e3d/0xe6fd1fdb5550157b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.224165:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.224166:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.224168:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.224284:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.224290:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.224298:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.224301:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.224305:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.224315:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.224323:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.224330:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.224360:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.224734:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.224740:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.224749:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.224752:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.224772:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.224783:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.224790:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000359677a1/0xe6fd1fdb55501582 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.224813:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.224814:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.224816:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.224989:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.224996:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225005:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.225009:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.225013:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225023:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225055:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225063:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225081:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947653.225113:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.225119:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.225127:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5fc00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.225130:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.225149:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.225161:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.225168:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052decbc7/0xe6fd1fdb55501589 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.225184:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.225186:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.225188:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.225396:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.225402:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225411:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.225420:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.225425:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225434:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225442:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225448:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225479:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.225564:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.225569:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.225577:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.225730:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.225739:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.225751:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.225769:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e08e342/0xe6fd1fdb55501590 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.225783:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.225785:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.225786:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.225908:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.225914:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225923:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.225927:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.225931:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225940:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225949:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225961:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.225983:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947653.226111:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.226117:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.226125:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.226129:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.226137:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.226148:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.226165:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000054eecf4/0xe6fd1fdb55501597 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.226180:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.226182:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.226185:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.226227:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.226232:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226241:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.226244:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.226247:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226255:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226263:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226270:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226349:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.226436:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.226441:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.226449:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5fa00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.226453:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.226655:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.226666:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.226674:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc5dbaeb/0xe6fd1fdb5550159e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.226687:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.226689:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.226690:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947653.226810:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.226817:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226831:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.226834:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.226838:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226848:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226857:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226865:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.226886:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783947653.227226:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947653.227232:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.227240:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1783947653.227243:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947653.227247:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.227255:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.227272:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.227338:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947653.227344:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.227352:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5fe00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947653.227357:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.227364:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.227375:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.227382:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f7da3ba/0xe6fd1fdb555015a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.227406:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.227408:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.227409:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.231212:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.231251:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947653.231817:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.231826:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.231836:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.231841:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.231852:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.231873:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.231882:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008645af55/0xe6fd1fdb555015ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.231904:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.231906:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.231909:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947653.231972:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947653.231980:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.231993:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1783947653.231998:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947653.232004:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232017:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232026:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232034:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232199:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947653.232608:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947653.232615:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232626:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1783947653.232629:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947653.232644:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232666:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232675:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.232682:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232804:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947653.232811:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232818:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.232822:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232839:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232851:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232858:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000638cfbcb/0xe6fd1fdb555015b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232874:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.232878:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232884:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.232887:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232894:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232903:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.232911:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.232913:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.232920:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.236361:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947653.236376:0:18593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a35b2e/0xe6fd1fdb555015ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947653.237028:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947653.237037:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.237050:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1783947653.237055:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947653.237062:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.237075:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.237205:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.237213:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.237353:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947653.238059:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947653.238066:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.238078:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1783947653.238081:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947653.238228:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.238241:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.238249:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.238257:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.238414:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783947653.238424:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.238433:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947653.238438:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.238447:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.238484:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.238493:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086432c47/0xe6fd1fdb555015c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.238510:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.238513:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947653.238517:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.238519:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947653.238519:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.238529:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947653.238533:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.238540:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.238551:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.238559:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.238561:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.238563:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.238616:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947653.238621:0:18593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd26a7e/0xe6fd1fdb555015c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947653.239064:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947653.239071:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.239080:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1783947653.239084:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947653.239336:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.239347:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.239357:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.239364:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.239526:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947653.239951:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947653.239958:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.239975:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1783947653.239978:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947653.239983:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.239991:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.240000:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.240007:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240068:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947653.240080:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240172:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947653.240177:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240186:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240201:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240209:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008afb3714/0xe6fd1fdb555015cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240228:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947653.240232:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240238:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947653.240240:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240247:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240268:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.240338:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.240341:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.240343:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.240520:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947653.240526:0:18593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c5ea457/0xe6fd1fdb555015d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947653.240939:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947653.240946:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.240956:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1783947653.240960:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947653.240964:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.240986:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.241019:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947653.241027:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.242367:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947653.242368:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.242378:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.242478:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947653.242483:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.242492:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.242510:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947653.242521:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.242523:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947653.242525:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947653.242578:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783947653.242585:0:18593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006213dd48/0xe6fd1fdb555015dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783947653.242758:0:18593:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1783947653.242873:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17112:x1870604236157696:12345-0@lo:5:osp-pre-0-0.0 Request processed in 123714us (123894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947653.242883:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783947653.243531:0:17112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1870604236157696:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783947653.243550:0:17112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1783947653.243598:0:17112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1870604236157824:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783947653.243638:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947653.243684:0:17112:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947653.243730:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157824 00000100:00100000:2.0:1783947653.243737:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157824 00000100:00100000:2.0:1783947653.243781:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947653.243809:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17112:x1870604236157824:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783947653.243844:0:18594:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1783947653.244110:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783947653.250587:0:18589:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1783947653.250627:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783947653.250951:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17112:x1870604236157824:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7140us (7308us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783947653.250963:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947653.251056:0:17112:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1783947653.251066:0:17112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17112:1870604236157824:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783947653.251082:0:17112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1783947653.363676:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783947653.363715:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236157952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947653.363800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947653.363884:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236157952 00000100:00100000:0.0:1783947653.363892:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236157952 00000100:00100000:0.0:1783947653.363956:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947653.363965:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236157952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947653.364001:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947653.364049:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236157952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947653.364056:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783947653.364117:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236157952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947653.364579:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783947653.364590:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236158080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947653.364628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947653.364693:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158080 00000100:00100000:1.0:1783947653.364698:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158080 00000100:00100000:1.0:1783947653.364737:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947653.364745:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236158080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947653.364777:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947653.364834:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236158080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947653.364842:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783947653.364883:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236158080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783947653.364897:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236158208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947653.364981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947653.366631:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158208 00000100:00100000:1.0:1783947653.366641:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158208 00000100:00100000:1.0:1783947653.367066:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783947653.367076:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236158208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947653.367110:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783947653.367233:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236158208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947653.367241:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783947653.367423:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236158208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783947653.875846:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947654.260146:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1783947654.807484:0:19408:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783947654.807488:0:19408:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783947654.807490:0:19408:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783947654.807619:0:19408:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9e7ac7c05800 00000020:01000004:2.0:1783947654.807636:0:19408:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783947654.807650:0:19408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783947654.807662:0:19408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e7bc5513380) 00000020:00000080:2.0:1783947654.807676:0:19408:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783947654.862823:0:19408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783947654.865832:0:19408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783947654.866338:0:19408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783947654.866816:0:19408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783947654.867414:0:19408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783947654.869195:0:19408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1783947654.869571:0:19408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1783947654.870727:0:19408:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783947654.870997:0:19408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783947654.871011:0:19408:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783947654.871023:0:19408:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6fd1fdb555015eb 00000020:01000004:2.0:1783947654.871031:0:19408:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783947654.871055:0:19408:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783947654.871059:0:19408:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783947654.871065:0:19408:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783947654.871095:0:19408:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1783947654.871099:0:19408:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783947654.895858:0:19408:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783947654.895896:0:19408:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.103@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1783947654.895900:0:19408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783947654.895902:0:19408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947654.895903:0:19408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947654.895905:0:19408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947654.895906:0:19408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947654.895907:0:19408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947654.895908:0:19408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947654.895910:0:19408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947654.895911:0:19408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783947654.895915:0:19408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1783947654.895917:0:19408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947654.895918:0:19408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947654.895919:0:19408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947654.895920:0:19408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947654.895924:0:19408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947654.895925:0:19408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947654.895926:0:19408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947654.895927:0:19408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947654.895928:0:19408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783947654.895952:0:19408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783947654.895971:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783947654.896053:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947654.896152:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947654.898163:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158336 00000100:00100000:1.0:1783947654.898175:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158336 00000100:00100000:1.0:1783947654.898293:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783947654.898304:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:19408:x1870604236158336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783947654.898342:0:17080:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783947654.898346:0:17080:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783947654.898350:0:17080:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783947654.899270:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:19408:x1870604236158336:12345-0@lo:253:mount.lustre.0 Request processed in 965us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947654.899281:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783947654.899925:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783947654.899940:0:19408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783947654.899944:0:19408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783947654.899946:0:19408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783947654.899947:0:19408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783947654.899948:0:19408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783947654.899949:0:19408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783947654.899950:0:19408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783947654.899952:0:19408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783947654.899954:0:19408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783947654.899955:0:19408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783947654.900138:0:19408:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e7ac7c05800 from lustre-OST0001 10000000:01000000:2.0:1783947654.900171:0:19408:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783947654.900174:0:19408:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783947654.900182:0:19408:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e7ac7798000 local copy 00010000:00010000:2.0:1783947654.900191:0:19408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947654.900303:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947654.900342:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947654.900388:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947654.900546:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158464 00000100:00100000:0.0:1783947654.900552:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158464 00000100:00100000:0.0:1783947654.900598:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783947654.900613:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:19408:x1870604236158464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947654.900679:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:19408:x1870604236158464:12345-0@lo:501:mount.lustre.0 Request processed in 67us (336us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783947654.900686:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783947654.900936:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158464:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783947654.900951:0:19408:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783947654.900967:0:19408:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783947654.900973:0:19408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947654.901094:0:19408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54a00/0xe6fd1fdb55501241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501248 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947654.901139:0:19408:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e7ac7c05800 10000000:01000000:2.0:1783947654.901144:0:19408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783947654.901149:0:19408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783947654.901152:0:19408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783947654.901156:0:19408:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783947654.901158:0:19408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783947654.901181:0:19408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947654.901188:0:19408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947654.901198:0:19408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947654.901210:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783947654.901236:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947654.901336:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947654.901398:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158592 00000100:00100000:1.0:1783947654.901403:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158592 00000100:00100000:1.0:1783947654.901437:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783947654.901445:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:19408:x1870604236158592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947654.901472:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947654.901494:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55000/0xe6fd1fdb555015f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555015f2 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.901514:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55000/0xe6fd1fdb555015f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555015f2 expref: 22 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.901525:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d55000/0xe6fd1fdb555015f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555015f2 expref: 22 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.901534:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55000, rc 0) 00000100:00100000:1.0:1783947654.901564:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236158592:12345-0@lo:101:mount.lustre.0 Request processed in 121us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947654.901571:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783947654.901922:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783947654.901942:0:19408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947654.901951:0:19408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947654.905195:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00010000:00010000:3.0:1783947654.905957:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783947654.906266:0:19408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947654.914435:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783947654.914525:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783947654.914542:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783947654.914555:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783947654.914570:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783947654.914598:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783947654.914637:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783947654.914643:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783947654.914780:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947654.914848:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947654.914896:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc77cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1783947654.916213:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158720 00000100:00100000:1.0:1783947654.916224:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158720 00000100:00100000:1.0:1783947654.916284:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783947654.916293:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236158720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947654.916492:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236158720:12345-0@lo:501:mount.lustre.0 Request processed in 200us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947654.916500:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783947654.916688:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947654.916732:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947654.916796:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947654.916821:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947654.917038:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158848 00000100:00100000:0.0:1783947654.917044:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158848 00000100:00100000:0.0:1783947654.917072:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783947654.917079:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236158848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947654.923214:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236158848:12345-0@lo:503:mount.lustre.0 Request processed in 6126us (6408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947654.923230:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783947654.923909:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783947654.924560:0:19408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783947654.924687:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947654.924777:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947654.924819:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947654.925020:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236158976 00000100:00100000:0.0:1783947654.925027:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236158976 00000100:00100000:0.0:1783947654.925081:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783947654.925090:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236158976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947654.925676:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236158976:12345-0@lo:502:mount.lustre.0 Request processed in 586us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947654.925685:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783947654.926049:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236158976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947654.926349:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783947654.926386:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783947654.926403:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783947654.926416:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783947654.926430:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783947654.926443:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783947654.926484:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783947654.926501:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783947654.926520:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783947654.926558:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947654.926892:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947654.926921:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc3213840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947654.926991:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236159104 00000100:00100000:0.0:1783947654.926997:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236159104 00000100:00100000:0.0:1783947654.927044:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783947654.927054:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236159104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947654.927163:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236159104:12345-0@lo:502:mount.lustre.0 Request processed in 110us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947654.927170:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783947654.927390:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783947654.927442:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1783947654.927451:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1783947654.928860:0:19412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783947654.928871:0:19412:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1783947654.928878:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783947654.928880:0:19412:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783947654.928887:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783947654.928914:0:19412:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e7ac7220000) 00000020:00000080:2.0:1783947654.928941:0:19412:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783947654.928948:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783947654.929092:0:19412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7ac7c05800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783947654.929100:0:19412:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783947654.929107:0:19412:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe6fd1fdb55501607 00010000:00010000:2.0:1783947654.934821:0:19412:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1783947654.935332:0:19412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1783947654.946178:0:19412:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1783947654.948685:0:19412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783947654.948698:0:19412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947654.948705:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947654.948708:0:19412:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783947654.948712:0:19412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947654.948716:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947654.948717:0:19412:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783947654.948721:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783947654.948723:0:19412:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783947654.948747:0:19412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947654.948750:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947654.948752:0:19412:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783947654.948754:0:19412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783947654.948757:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947654.948767:0:19412:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783947654.948771:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783947654.948799:0:19412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783947654.948802:0:19412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783947654.948803:0:19412:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783947654.948807:0:19412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1783947654.949274:0:19408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783947654.949334:0:19408:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783947654.949360:0:19408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.949373:0:19408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffa5e000/0xe6fd1fdb555015f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555015f9 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947654.949383:0:19408:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7ac7c05800 from 1 10000000:01000000:3.0:1783947654.949385:0:19408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947654.949421:0:19408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.949429:0:19408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.949440:0:19408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947654.949497:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783947654.949565:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947654.949777:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1783947654.949800:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236159232 00000100:00100000:3.0:1783947654.949807:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236159232 00000100:00100000:3.0:1783947654.949861:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783947654.949871:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236159232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947654.949885:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947654.949898:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550160e expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.949923:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.949942:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.949952:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e50800, rc 0) 00000100:00100000:3.0:1783947654.950159:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159232:12345-0@lo:101:mount.lustre.0 Request processed in 289us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947654.950167:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783947654.952836:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783947654.952865:0:19408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947654.952877:0:19408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947654.962199:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783947654.962519:0:19408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947654.962851:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783947654.962876:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783947654.962891:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783947654.962895:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783947654.962971:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947654.963108:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947654.963146:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7803180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947654.963342:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236159360 00000100:00100000:2.0:1783947654.963350:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236159360 00000100:00100000:2.0:1783947654.963439:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783947654.963449:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783947654.963600:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159360:12345-0@lo:501:mount.lustre.0 Request processed in 152us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947654.963608:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783947654.963694:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947654.963727:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947654.963775:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947654.966667:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7803180 going to sleep for 11 seconds 00000100:00100000:0.0:1783947654.967793:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236159488 00000100:00100000:0.0:1783947654.967805:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236159488 00000100:00100000:1.0:1783947654.967948:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783947654.967958:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783947654.968134:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159488:12345-0@lo:503:mount.lustre.0 Request processed in 176us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947654.968142:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783947654.968499:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159488:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783947654.969067:0:19408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947654.969148:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947654.969205:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947654.969233:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bcb6be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947654.969429:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236159616 00000100:00100000:1.0:1783947654.969435:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236159616 00000100:00100000:1.0:1783947654.969505:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783947654.969513:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947654.969741:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159616:12345-0@lo:502:mount.lustre.0 Request processed in 227us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947654.969748:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783947654.969829:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783947654.971166:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783947654.971211:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783947654.971228:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783947654.971668:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783947654.971695:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783947654.971707:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783947654.971718:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783947654.971731:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1783947654.971746:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783947654.971771:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1783947654.971787:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1783947654.971832:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783947654.971903:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947654.971946:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7803f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783947654.972142:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236159744 00000100:00100000:2.0:1783947654.972150:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236159744 00000100:00100000:2.0:1783947654.972204:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783947654.972214:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947654.972411:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159744:12345-0@lo:502:mount.lustre.0 Request processed in 197us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947654.972427:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783947654.972784:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783947654.972839:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1783947654.972850:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783947654.974370:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947654.974382:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.974384:0:19416:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783947654.974391:0:19416:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7ac7c05800 00000020:00000080:3.0:1783947654.974394:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947654.974402:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947654.974404:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.974405:0:19416:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783947654.974408:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947654.974410:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.974411:0:19416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783947654.974414:0:19416:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e7ac7c05800 00000020:00000080:3.0:1783947654.974415:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947654.974590:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947654.974593:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.974595:0:19416:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783947654.974597:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947654.974599:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.974600:0:19416:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947654.974604:0:19416:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7ac7c05800 00000020:00000080:3.0:1783947654.974605:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947654.975081:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947654.975086:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.975095:0:19416:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783947654.975099:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783947654.975101:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.975103:0:19416:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783947654.975106:0:19416:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e7ac7c05800 00000020:00000080:3.0:1783947654.975108:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783947654.975136:0:19416:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783947654.975138:0:19416:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783947654.975139:0:19416:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783947654.975142:0:19416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1783947654.977008:0:19408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783947654.977049:0:19408:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947654.977072:0:19408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.977096:0:19408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947654.977158:0:19408:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783947654.977161:0:19408:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e7ac7c05800 10000000:01000000:1.0:1783947654.977164:0:19408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e7ac7c05800 10000000:01000000:1.0:1783947654.977168:0:19408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783947654.977174:0:19408:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9e7ac7c05800 from 1 10000000:01000000:1.0:1783947654.977177:0:19408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783947654.977213:0:19408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.977221:0:19408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947654.977232:0:19408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947654.978753:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783947654.978833:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947654.984110:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7803180 going to sleep for 11 seconds 00000100:00100000:3.0:1783947654.984176:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236159872 00000100:00100000:3.0:1783947654.984187:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236159872 00000100:00100000:3.0:1783947654.984338:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783947654.984351:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:19408:x1870604236159872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783947654.984371:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947654.984389:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7e51800/0xe6fd1fdb55501623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550161c expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.984417:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7e51800/0xe6fd1fdb55501623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550161c expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.984428:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7e51800/0xe6fd1fdb55501623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550161c expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947654.984437:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7e51800, rc 0) 00000100:00100000:3.0:1783947654.984803:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236159872:12345-0@lo:101:mount.lustre.0 Request processed in 453us (5968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947654.984810:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783947655.000789:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236159872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783947655.000822:0:19408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.000836:0:19408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947655.003275:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1783947655.003753:0:19408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783947655.003926:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783947655.003949:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783947655.003962:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783947655.003971:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783947655.003981:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783947655.003992:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783947655.004003:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783947655.004015:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783947655.004027:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783947655.004040:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783947655.004067:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783947655.004080:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783947655.004091:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783947655.004102:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783947655.004112:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783947655.004124:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783947655.004136:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783947655.004147:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783947655.004159:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783947655.004170:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783947655.004183:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783947655.004196:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783947655.004208:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783947655.004222:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783947655.004235:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1783947655.005704:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1783947655.005748:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1783947655.005777:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1783947655.005792:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1783947655.005819:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1783947655.005834:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1783947655.005849:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1783947655.005863:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1783947655.005876:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1783947655.005890:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1783947655.005904:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1783947655.005918:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1783947655.005931:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1783947655.005944:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1783947655.005958:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1783947655.005972:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1783947655.005986:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1783947655.006013:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1783947655.006029:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1783947655.006042:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1783947655.006053:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1783947655.006077:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1783947655.006082:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1783947655.006185:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783947655.008555:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947655.014709:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160000 00000100:00100000:0.0:1783947655.014724:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160000 00000100:00100000:0.0:1783947655.014787:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783947655.014797:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947655.014974:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160000:12345-0@lo:501:mount.lustre.0 Request processed in 178us (6424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947655.014982:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783947655.015036:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7be7803480 going to sleep for 11 seconds 00000100:00100000:0.0:1783947655.015061:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783947655.015114:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783947655.015161:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947655.015188:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947655.015393:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160128 00000100:00100000:2.0:1783947655.015399:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160128 00000100:00100000:2.0:1783947655.015433:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783947655.015440:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783947655.015561:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160128:12345-0@lo:503:mount.lustre.0 Request processed in 121us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.015568:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783947655.016377:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783947655.017798:0:19408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783947655.017884:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947655.017955:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947655.017991:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947655.018372:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160256 00000100:00100000:2.0:1783947655.018378:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160256 00000100:00100000:2.0:1783947655.018428:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783947655.018437:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947655.018568:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160256:12345-0@lo:502:mount.lustre.0 Request processed in 132us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.018588:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783947655.018748:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783947655.018949:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783947655.018986:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783947655.019004:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783947655.019019:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783947655.019047:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783947655.019062:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783947655.019075:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783947655.019087:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783947655.019099:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783947655.019111:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783947655.019123:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783947655.019142:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783947655.019154:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783947655.019164:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783947655.019173:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783947655.019184:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783947655.019195:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783947655.019206:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783947655.019215:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783947655.019225:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783947655.019317:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783947655.019334:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783947655.019346:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783947655.019361:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783947655.019375:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783947655.019388:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783947655.019401:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783947655.019414:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783947655.019425:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783947655.019437:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783947655.019448:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783947655.019495:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783947655.019519:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783947655.019532:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783947655.019545:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783947655.019556:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783947655.019709:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783947655.019731:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783947655.019745:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783947655.019769:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783947655.019785:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783947655.019799:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783947655.019811:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783947655.019824:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783947655.019837:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783947655.019848:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783947655.019859:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783947655.019871:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783947655.019917:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783947655.019973:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947655.020011:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783947655.020368:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160384 00000100:00100000:2.0:1783947655.020377:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160384 00000100:00100000:2.0:1783947655.020432:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783947655.020441:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947655.020573:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160384:12345-0@lo:502:mount.lustre.0 Request processed in 133us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.020702:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783947655.021566:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947655.021844:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1783947655.021869:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1783947655.021906:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783947655.021961:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947655.022040:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947655.025320:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160512 00000100:00100000:3.0:1783947655.025336:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160512 00000100:00100000:3.0:1783947655.025400:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783947655.025418:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783947655.025860:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236160512:12345-0@lo:502:mount.lustre.0 Request processed in 443us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947655.025869:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783947655.025979:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236160512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783947655.026075:0:19408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1783947655.026092:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783947655.045035:0:19422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783947655.045054:0:19422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e7bc47b8000) 00000020:00000080:1.0:1783947655.045083:0:19422:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1783947655.045271:0:19422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7ac7c05800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783947655.045275:0:19422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7ac7c05800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783947655.045278:0:19422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7c05800 3 00010000:00080000:1.0:1783947655.045327:0:19422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7ac5827000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:1.0:1783947655.049171:0:19422:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1783947655.049289:0:19422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783947655.049337:0:19422:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783947655.049354:0:19422:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe6fd1fdb55501631 00000100:00080000:1.0:1783947655.049366:0:19422:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783947655.049372:0:19422:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e7ac5827000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947655.049406:0:19422:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d6a300 x1870604236160640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947655.049435:0:19422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783947655.049542:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783947655.049546:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783947655.049548:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947655.049553:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1783947655.049556:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783947655.049560:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7bc47c4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947655.049573:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d6bb80 x1870604236161024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783947655.049598:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783947655.049601:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783947655.049602:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783947655.049606:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 538 00000100:00080000:1.0:1783947655.049608:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783947655.049611:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bd1b69800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:1.0:1783947655.049620:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7bf7d68380 x1870604236161536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783947655.049662:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236160768:0@lo:400:kworker.0 00000100:00100000:1.0:1783947655.049726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947655.052656:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236160640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783947655.052735:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947655.052804:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236161024:0@lo:8:kworker.0 00000100:00100000:3.0:1783947655.052834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947655.052853:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236161536:0@lo:8:kworker.0 00000100:00100000:3.0:1783947655.052872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947655.052911:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161024 00000100:00100000:3.0:1783947655.052919:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161024 00000100:00100000:3.0:1783947655.052953:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161536 00000100:00100000:3.0:1783947655.052955:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161536 00000100:00100000:3.0:1783947655.052974:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947655.052991:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236161024:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783947655.053055:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236161024:12345-0@lo:8:kworker.0 Request processed in 63us (218us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783947655.053062:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783947655.053079:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947655.053083:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236161536:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783947655.053112:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236161536:12345-0@lo:8:kworker.0 Request processed in 28us (239us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783947655.053117:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783947655.053159:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947655.053166:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947655.053184:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783947655.053188:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236161024:0@lo:8:kworker.0 00000100:00100000:3.0:1783947655.053199:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947655.053202:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783947655.053205:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783947655.053208:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236161536:0@lo:8:kworker.0 00000100:00100000:3.0:1783947655.053750:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160640 00000100:00100000:3.0:1783947655.053765:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160640 00000100:00100000:3.0:1783947655.053796:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947655.053802:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1870604236160640:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783947655.053822:0:17088:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1783947655.053857:0:17088:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe6fd1fdb55501638 00000004:00100000:3.0:1783947655.053871:0:17088:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783947655.053899:0:17088:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34cb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947655.053946:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1870604236160640:12345-0@lo:38:llog_process_th.0 Request processed in 144us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947655.053953:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783947655.053993:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d6a300 x1870604236160640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947655.054003:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783947655.054009:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1783947655.054015:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783947655.054020:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783947655.054022:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5827000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783947655.054027:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1870604236160640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783947655.055446:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236161408:0@lo:400:kworker.0 00000100:00100000:1.0:1783947655.055554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947655.055596:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783947655.055604:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236161280:0@lo:400:kworker.0 00000100:00100000:1.0:1783947655.055628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947655.055687:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161408 00000100:00100000:3.0:1783947655.055695:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161408 00000100:00100000:3.0:1783947655.055754:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783947655.055776:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236161408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947655.055824:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236161408:12345-0@lo:400:kworker.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947655.055831:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783947655.055852:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947655.057748:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236160896:0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.057826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947655.057859:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236161664:0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.057883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947655.057906:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783947655.057913:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236161152:0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.057934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947655.057949:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236161792:0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.057968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947655.058017:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160896 00000100:00100000:2.0:1783947655.058024:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160896 00000100:00100000:2.0:1783947655.058081:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947655.058089:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236160896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.058139:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236160896:12345-0@lo:400:kworker.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.058145:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947655.058166:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161664 00000100:00100000:2.0:1783947655.058170:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161664 00000100:00100000:2.0:1783947655.058193:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161152 00000100:00100000:2.0:1783947655.058196:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161152 00000100:00100000:2.0:1783947655.058224:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161792 00000100:00100000:2.0:1783947655.058227:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161792 00000100:00100000:2.0:1783947655.058256:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947655.058262:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236161664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.058294:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236161664:12345-0@lo:400:kworker.0 Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.058301:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783947655.058313:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947655.058319:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236161152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.058344:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236161152:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.058349:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947655.058360:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783947655.058365:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236161792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.058390:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236161792:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.058395:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1783947655.058415:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783947655.058420:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783947655.058449:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68000 x1870604236161152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947655.058485:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236161152:0@lo:400:kworker.0 00010000:00080000:2.0:1783947655.058497:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac85ed500 x1870604236161792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947655.058506:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236161792:0@lo:400:kworker.0 00000100:00100000:2.0:1783947655.058529:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236160896:0@lo:400:kworker.0 00010000:00080000:2.0:1783947655.058538:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7bf7d68700 x1870604236161664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947655.058547:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236161664:0@lo:400:kworker.0 00000020:01000004:2.0:1783947655.063842:0:19422:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783947655.063859:0:19422:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9e7ac7224d40) 00000020:00000080:2.0:1783947655.063884:0:19422:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:1.0:1783947655.064514:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236161920:0@lo:400:kworker.0 00000100:00100000:1.0:1783947655.064571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947655.064622:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236161408:0@lo:400:kworker.0 00000100:00100000:1.0:1783947655.064660:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161920 00000100:00100000:1.0:1783947655.064665:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161920 00000100:00100000:1.0:1783947655.064711:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783947655.064718:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236161920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947655.064774:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236161920:12345-0@lo:400:kworker.0 Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947655.064780:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1783947655.064798:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783947655.064817:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac85ed880 x1870604236161920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947655.064827:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236161920:0@lo:400:kworker.0 00000100:00100000:0.0:1783947655.066351:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236160768 00000100:00100000:0.0:1783947655.066360:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236160768 00000100:00100000:0.0:1783947655.066395:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236161280 00000100:00100000:0.0:1783947655.066397:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236161280 00000100:00100000:0.0:1783947655.066410:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947655.066417:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236160768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947655.066498:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236160768:12345-0@lo:400:kworker.0 Request processed in 81us (16771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947655.066504:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783947655.066517:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783947655.066522:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236161280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947655.066552:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236161280:12345-0@lo:400:kworker.0 Request processed in 30us (10923us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947655.066557:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783947655.066691:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236161280:0@lo:400:kworker.0 00000100:00100000:1.0:1783947655.066702:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236160768:0@lo:400:kworker.0 00000020:01000004:0.0:1783947655.067552:0:19422:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e7ac7c05800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783947655.067559:0:19422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e7ac7c05800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783947655.067562:0:19422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e7ac7c05800 3 00010000:00080000:0.0:1783947655.067675:0:19422:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e7be7a21000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.103@tcp at head 00010000:00010000:0.0:1783947655.071142:0:19422:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1783947655.071668:0:19422:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1783947655.071738:0:19422:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783947655.071751:0:19422:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xe6fd1fdb55501646 00000100:00080000:0.0:1783947655.071908:0:19422:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783947655.071914:0:19422:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9e7be7a21000 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:0.0:1783947655.071952:0:19422:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac7c90a80 x1870604236162048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947655.072159:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236162048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783947655.072227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783947655.072299:0:19422:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783947655.072790:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162048 00000100:00100000:0.0:1783947655.072797:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162048 00000100:00100000:0.0:1783947655.072829:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783947655.072835:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1870604236162048:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783947655.072861:0:17088:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1783947655.072888:0:17088:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xe6fd1fdb5550164d 00000004:00100000:0.0:1783947655.072904:0:17088:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783947655.072936:0:17088:0:(import.c:65:import_set_state_nolock()) ffff9e7bc4732800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947655.080538:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1870604236162048:12345-0@lo:38:llog_process_th.0 Request processed in 7692us (8302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947655.080553:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783947655.081045:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e7ac7c90a80 x1870604236162048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783947665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947655.081058:0:3636:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783947655.081069:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783947655.081078:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783947655.081083:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783947655.081087:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7be7a21000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783947655.081094:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1870604236162048:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1783947655.081971:0:19422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1783947655.086073:0:19408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783947655.086132:0:19408:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783947655.086158:0:19408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947655.086170:0:19408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55a00/0xe6fd1fdb5550161c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501623 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783947655.086228:0:19408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783947655.086230:0:19408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947655.086232:0:19408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947655.086233:0:19408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947655.086234:0:19408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947655.086236:0:19408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947655.086248:0:19408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947655.086250:0:19408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947655.086252:0:19408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947655.086256:0:19408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783947655.086258:0:19408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783947655.086259:0:19408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947655.086260:0:19408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947655.086261:0:19408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947655.086262:0:19408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947655.086263:0:19408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947655.086264:0:19408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947655.086265:0:19408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947655.086266:0:19408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783947655.086295:0:19408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783947655.086318:0:19408:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236162176:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783947655.086390:0:19408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947655.086426:0:19408:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947655.086589:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162176 00000100:00100000:2.0:1783947655.086597:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162176 00000100:00100000:2.0:1783947655.086645:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783947655.086653:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:19408:x1870604236162176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783947655.086682:0:17080:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783947655.086699:0:17080:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783947655.097786:0:17080:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783947655.097817:0:17080:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783947655.098321:0:17103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783947655.098326:0:17103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783947655.098348:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947655.098377:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 24 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947655.098384:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947655.098391:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947655.098429:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947655.098442:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 24 pid: 17082 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947655.098487:0:17103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236162304:0@lo:104: 00000100:00100000:0.0:1783947655.098555:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947655.098682:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162304 00000100:00100000:1.0:1783947655.098692:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162304 00000100:00100000:1.0:1783947655.098743:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947655.098753:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236162304:12345-0@lo:104: 00010000:00010000:1.0:1783947655.098784:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.098837:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783947655.098843:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236162304:12345-0@lo:104: Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947655.098850:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1783947655.098872:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947655.098878:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.098885:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50a00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:1.0:1783947655.098889:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.098898:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783947655.098905:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947655.098911:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783947655.098936:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.098942:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783947655.098962:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.098969:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e50a00/0xe6fd1fdb5550150b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501512 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.098998:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947655.099000:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947655.099002:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947655.099015:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236162432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783947655.099045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947655.099096:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162432 00000100:00100000:1.0:1783947655.099100:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162432 00010000:00010000:1.0:1783947655.099114:0:17072:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 25 pid: 17082 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947655.099135:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947655.099141:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+25:3638:x1870604236162432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783947655.099150:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947655.099155:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 25 pid: 17082 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.099164:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 25 pid: 17082 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947655.099178:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947655.099198:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+25:3638:x1870604236162432:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947655.099204:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947655.099253:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236162432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947655.099404:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 24 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947655.099415:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 24 pid: 17080 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947655.099423:0:17103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236162560:0@lo:104: 00000100:00100000:0.0:1783947655.099447:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947655.099488:0:17103:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657d540 going to sleep for 11 seconds 00010000:00010000:0.0:1783947655.099500:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846bc00/0xe6fd1fdb55501512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550150b expref: 24 pid: 17082 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947655.099521:0:17103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236162304:0@lo:104: 00000100:00100000:2.0:1783947655.099681:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162560 00000100:00100000:2.0:1783947655.099686:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162560 00000100:00100000:2.0:1783947655.099709:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947655.099716:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236162560:12345-0@lo:104: 00010000:00010000:2.0:1783947655.099725:0:17070:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.099786:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947655.099791:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:17103:x1870604236162560:12345-0@lo:104: Request processed in 76us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.099797:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947655.099823:0:17103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17103:1870604236162560:0@lo:104: 00010000:00010000:2.0:1783947655.099840:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.099855:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947655.099874:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.099882:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947655.099886:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.099893:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947655.099900:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947655.099916:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783947655.099935:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.099941:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947655.099957:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.099964:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51c00/0xe6fd1fdb555014fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501504 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.099990:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947655.099992:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947655.099994:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947655.100003:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236162688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947655.100031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947655.100062:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162688 00000100:00100000:2.0:1783947655.100066:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162688 00010000:00010000:2.0:1783947655.100081:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 24 pid: 17080 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947655.100103:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783947655.100110:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236162688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947655.100118:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947655.100123:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 24 pid: 17080 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100132:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 24 pid: 17080 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100149:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55c00/0xe6fd1fdb55501504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555014fd expref: 24 pid: 17080 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100161:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100169:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783947655.100182:0:17074:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012079822s 00010000:00010000:2.0:1783947655.100186:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100194:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100200:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100207:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100212:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947655.100216:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100223:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.100237:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.101733:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947655.101819:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:3639:x1870604236162688:12345-0@lo:103:ldlm_bl.0 Request processed in 1707us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947655.101829:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783947655.101874:0:17103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.101882:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947655.101888:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501654 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947655.101929:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236162688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783947655.105850:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:19408:x1870604236162176:12345-0@lo:253:mount.lustre.0 Request processed in 19185us (19448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947655.105867:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783947655.106028:0:19408:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:19408:1870604236162176:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783947655.106046:0:19408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783947655.106049:0:19408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783947655.106051:0:19408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783947655.106052:0:19408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783947655.106054:0:19408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783947655.106055:0:19408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783947655.106056:0:19408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783947655.106057:0:19408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783947655.106059:0:19408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783947655.106061:0:19408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783947655.106078:0:19408:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1783947655.108802:0:19408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783947655.123779:0:19408:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783947655.123791:0:19408:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783947655.123830:0:19408:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783947655.123875:0:19408:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783947655.123894:0:19408:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1783947655.123919:0:19408:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1783947655.125004:0:19408:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947655.125245:0:19408:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783947655.925637:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783947656.082368:0:19476:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783947656.082727:0:19476:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1783947656.307563:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783947656.307571:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7bff95d000 from 10 10000000:01000000:1.0:1783947656.307588:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783947656.307636:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947656.307649:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947656.307661:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947656.307689:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236162816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947656.307767:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947656.307813:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5dc4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783947656.307883:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162816 00000100:00100000:0.0:1783947656.307890:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162816 00000100:00100000:0.0:1783947656.307942:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947656.307951:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:17085:x1870604236162816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947656.307967:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947656.307982:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb55501662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb5550165b expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.308012:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb55501662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb5550165b expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.308023:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b400/0xe6fd1fdb55501662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550165b expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.308032:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b400, rc 0) 00000100:00100000:0.0:1783947656.308070:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236162816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947656.308078:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783947656.308123:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236162816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947656.308136:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.308144:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947656.308186:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236162944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783947656.308212:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947656.308225:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947656.309670:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236162944 00000100:00100000:0.0:1783947656.309679:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236162944 00000100:00100000:0.0:1783947656.309727:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783947656.309746:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236162944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783947656.309770:0:17080:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783947656.309789:0:17080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783947656.309797:0:17080:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1783947656.309897:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236162944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947656.309905:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783947656.309943:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236162944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783947656.310000:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783947656.310008:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.310019:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d55600/0xe6fd1fdb5550165b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501662 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783947656.310028:0:17085:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783947656.310030:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9e7ac7ff8000 from 10 10000000:01000000:0.0:1783947656.310032:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783947656.310055:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.310063:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.310072:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947656.310088:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236163072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947656.310111:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947656.310134:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947656.310145:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163072 00000100:00100000:0.0:1783947656.310148:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163072 00000100:00100000:0.0:1783947656.310172:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783947656.310177:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236163072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947656.310185:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947656.310195:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501669 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.310212:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501669 expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.310222:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffb9b000/0xe6fd1fdb55501670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501669 expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.310229:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9b000, rc 0) 00000100:00100000:0.0:1783947656.310251:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236163072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947656.310256:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783947656.311153:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236163072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947656.311170:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947656.311179:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947656.311233:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236163200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783947656.311588:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947656.311632:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947656.311801:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163200 00000100:00100000:3.0:1783947656.311807:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163200 00000100:00100000:3.0:1783947656.311850:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783947656.311860:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236163200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783947656.311878:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783947656.311894:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783947656.311897:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1783947656.311988:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236163200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947656.311996:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783947656.312063:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236163200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783947656.312119:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783947656.312127:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947656.312136:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bffb9ae00/0xe6fd1fdb55501669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb55501670 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947656.947727:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947657.971687:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947658.484792:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947658.484817:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236163328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947658.484920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947658.485658:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236163456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947658.485717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947658.485822:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947658.485830:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236163584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947658.486521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947658.486581:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163456 00000100:00100000:1.0:1783947658.486589:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163456 00000100:00100000:1.0:1783947658.486636:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163584 00000100:00100000:1.0:1783947658.486641:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163584 00000100:00100000:1.0:1783947658.486657:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947658.486665:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236163456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947658.486710:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947658.486852:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236163456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947658.486860:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783947658.486878:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783947658.486898:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236163584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947658.486909:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947658.486935:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236163584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947658.486941:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783947658.486958:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947658.486993:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236163584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947658.487009:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236163456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947658.487913:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163328 00000100:00100000:0.0:1783947658.487921:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163328 00000100:00100000:0.0:1783947658.487963:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947658.487972:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236163328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947658.488002:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947658.488065:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236163328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (3146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947658.488072:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783947658.488112:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236163328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947658.495373:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947658.497825:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236163712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947658.497906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947658.497967:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163712 00000100:00100000:2.0:1783947658.497978:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163712 00000100:00100000:2.0:1783947658.498049:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947658.498059:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236163712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947658.498099:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783947658.498151:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236163712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947658.498159:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783947658.498212:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236163712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783947658.995589:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.026055:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783947660.531711:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947660.531718:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783947660.531721:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947660.531733:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e7bc47c4800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947660.531755:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e1180 x1870604236164224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783947660.531789:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783947660.531792:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783947660.531793:0:38:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783947660.531798:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9e7bd1b69800 using connection 192.168.204.103@tcp/0@lo 00000100:00100000:2.0:1783947660.531808:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e7ac76e0000 x1870604236164736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783947660.531870:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236163840:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.531941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.531987:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236164480:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532035:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236165120:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532072:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532097:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783947660.532102:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236164352:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532141:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236164992:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532190:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236163968:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532212:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532228:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236164608:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532268:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236165248:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532309:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783947660.532315:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236164096:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532359:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236164864:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532378:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532387:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236165376:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532424:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236164224:0@lo:8:kworker.0 00000100:00100000:2.0:1783947660.532443:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532477:0:3636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236164736:0@lo:8:kworker.0 00000100:00100000:2.0:1783947660.532496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.532523:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163840 00000100:00100000:2.0:1783947660.532537:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163840 00000100:00100000:2.0:1783947660.532584:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783947660.532593:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3640:x1870604236163840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532643:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3640:x1870604236163840:12345-0@lo:400:kworker.0 Request processed in 52us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.532664:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783947660.532697:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164480 00000100:00100000:2.0:1783947660.532701:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164480 00000100:00100000:2.0:1783947660.532725:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236163968 00000100:00100000:2.0:1783947660.532727:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236163968 00000100:00100000:2.0:1783947660.532741:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947660.532747:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236164480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532779:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236164480:12345-0@lo:400:kworker.0 Request processed in 32us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.532785:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783947660.532797:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947660.532802:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236163968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.532834:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236163968:12345-0@lo:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.532840:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783947660.532857:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236165120 00000100:00100000:2.0:1783947660.532861:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236165120 00000100:00100000:2.0:1783947660.532889:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164352 00000100:00100000:2.0:1783947660.532892:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164352 00000100:00100000:2.0:1783947660.532902:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164992 00000100:00100000:2.0:1783947660.532905:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164992 00000100:00100000:2.0:1783947660.532917:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236165248 00000100:00100000:2.0:1783947660.532919:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236165248 00000100:00100000:2.0:1783947660.532930:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164864 00000100:00100000:2.0:1783947660.532939:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164864 00000100:00100000:2.0:1783947660.532953:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236165376 00000100:00100000:2.0:1783947660.532956:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236165376 00000100:00100000:2.0:1783947660.532970:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947660.532976:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236165120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533006:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1870604236165120:12345-0@lo:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533012:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783947660.533022:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947660.533028:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236164352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533071:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236164352:12345-0@lo:400:kworker.0 Request processed in 43us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533076:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947660.533086:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947660.533092:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236164992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533116:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236164992:12345-0@lo:400:kworker.0 Request processed in 25us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533128:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783947660.533139:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947660.533144:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236165248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533168:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236165248:12345-0@lo:400:kworker.0 Request processed in 25us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533174:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783947660.533185:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947660.533191:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236164864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533216:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236164864:12345-0@lo:400:kworker.0 Request processed in 25us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533228:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783947660.533241:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947660.533247:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236165376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533275:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236165376:12345-0@lo:400:kworker.0 Request processed in 29us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533280:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783947660.533312:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164608 00000100:00100000:2.0:1783947660.533316:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164608 00000100:00100000:2.0:1783947660.533336:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164096 00000100:00100000:2.0:1783947660.533338:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164096 00000100:00100000:2.0:1783947660.533349:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164224 00000100:00100000:2.0:1783947660.533352:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164224 00000100:00100000:2.0:1783947660.533359:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236164736 00000100:00100000:2.0:1783947660.533361:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236164736 00000100:00100000:2.0:1783947660.533368:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947660.533374:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236164608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533403:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236164608:12345-0@lo:400:kworker.0 Request processed in 28us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533408:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783947660.533418:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947660.533423:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236164096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.533449:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236164096:12345-0@lo:400:kworker.0 Request processed in 25us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533479:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783947660.533491:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947660.533495:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236164224:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783947660.533524:0:18595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1783947660.533562:0:18595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe6fd1fdb55501677 00002000:00100000:2.0:1783947660.533578:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e7ac5bc7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783947660.533582:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783947660.533586:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783947660.533780:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783947660.533804:0:18595:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947660.533850:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1870604236164224:12345-0@lo:8:kworker.0 Request processed in 353us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533856:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947660.533868:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947660.533873:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1870604236164736:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783947660.533888:0:18595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1783947660.533904:0:18595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xe6fd1fdb5550167e 00002000:00100000:2.0:1783947660.533909:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9e7ac5bc6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1783947660.533913:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1783947660.533915:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783947660.533935:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1783947660.533946:0:18595:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947660.533974:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1870604236164736:12345-0@lo:8:kworker.0 Request processed in 100us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.533980:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783947660.534040:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e1180 x1870604236164224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783947660.534058:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783947660.534065:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783947660.534070:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783947660.534078:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bc47c4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783947660.534090:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783947660.534095:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1870604236164224:0@lo:8:kworker.0 00010000:00080000:2.0:1783947660.534109:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0000 x1870604236164736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783947685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783947660.534118:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783947660.534122:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783947660.534124:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783947660.534126:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9e7bd1b69800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783947660.534137:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783947660.534140:0:3636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1870604236164736:0@lo:8:kworker.0 00000004:00080000:2.0:1783947660.534191:0:17114:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1783947660.534209:0:17114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1870604236165632:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783947660.534237:0:17114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.534253:0:17114:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e900 going to sleep for 11 seconds 00000004:00080000:2.0:1783947660.534266:0:17113:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783947660.534327:0:17113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 545761869394ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783947660.534333:0:17113:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783947660.534556:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236165504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947660.534581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947660.534619:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236164096:0@lo:400:kworker.0 00010000:00080000:2.0:1783947660.534631:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e1880 x1870604236164864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947660.534639:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236164864:0@lo:400:kworker.0 00010000:00080000:2.0:1783947660.534649:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e1c00 x1870604236165376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783947660.534732:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947660.534738:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947660.534740:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947660.534750:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236165504 00000100:00100000:1.0:1783947660.534755:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236165504 00000100:00100000:1.0:1783947660.534792:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783947660.534800:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236165504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947660.534821:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783947660.534862:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236165504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947660.534868:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783947660.534888:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783947660.534907:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac7500700 x1870604236165504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783947660.534921:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236165504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947660.535555:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236165632 00000100:00100000:3.0:1783947660.535568:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236165632 00000100:00100000:3.0:1783947660.535609:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947660.535618:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17114:x1870604236165632:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:0.0:1783947660.536555:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e3b80 x1870604236164352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947660.536572:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236164352:0@lo:400:kworker.0 00010000:00080000:0.0:1783947660.536585:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2680 x1870604236164992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947660.536594:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236164992:0@lo:400:kworker.0 00000100:00100000:0.0:1783947660.536605:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236163840:0@lo:400:kworker.0 00000100:00100000:0.0:1783947660.536618:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236164480:0@lo:400:kworker.0 00010000:00080000:0.0:1783947660.536630:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e0700 x1870604236165120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947660.536637:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1870604236165120:0@lo:400:kworker.0 00000100:00100000:0.0:1783947660.537042:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236165760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947660.537110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947660.537187:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236165760 00000100:00100000:1.0:1783947660.537193:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236165760 00000100:00100000:1.0:1783947660.537242:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783947660.537255:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1870604236165760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947660.537274:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000004:00080000:3.0:1783947660.537477:0:17831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783947660.537500:0:17831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17831:1870604236165888:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1783947660.537527:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947660.537549:0:17831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657d780 going to sleep for 11 seconds 00000004:00080000:3.0:1783947660.537563:0:17830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783947660.537644:0:17830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 545765186182ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783947660.537649:0:17830:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1783947660.537990:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236165376:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.538009:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236165888 00000100:00100000:2.0:1783947660.538014:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236165888 00000100:00100000:2.0:1783947660.538046:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783947660.538052:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:17831:x1870604236165888:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1783947660.538154:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1870604236165760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 899us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947660.538162:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783947660.538201:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1783947660.542624:0:17820:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:0.0:1783947660.545742:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc942ad80 x1870604236165760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947660.545774:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236165760:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1783947660.548437:0:18593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783947660.548448:0:18593:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1783947660.548453:0:18593:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:2.0:1783947660.549646:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236163968:0@lo:400:kworker.0 00000100:00100000:2.0:1783947660.549718:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236164608:0@lo:400:kworker.0 00010000:00080000:2.0:1783947660.549760:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac76e2d80 x1870604236165248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947660.549772:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236165248:0@lo:400:kworker.0 00000004:00080000:2.0:1783947660.554433:0:17067:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1783947660.571563:0:18594:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783947660.571573:0:18594:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783947660.571688:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17831:x1870604236165888:12345-0@lo:7:osp-pre-1-1.0 Request processed in 33630us (34154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947660.571699:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783947660.571755:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc9428a80 x1870604236165888/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783947676 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947660.571770:0:17831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17831:1870604236165888:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783947660.571783:0:17831:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783947660.571822:0:17831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17831:1870604236166016:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783947660.571854:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947660.571883:0:17831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac657d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783947660.573040:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166016 00000100:00100000:0.0:1783947660.573053:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166016 00000100:00100000:0.0:1783947660.573114:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783947660.573124:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17831:x1870604236166016:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1783947660.573232:0:18595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1783947660.573315:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17831:x1870604236166016:12345-0@lo:5:osp-pre-1-1.0 Request processed in 192us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947660.573324:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1783947660.573384:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bc9428a80 x1870604236166016/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783947676 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947660.573401:0:17831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17831:1870604236166016:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783947660.573412:0:17831:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1783947660.574298:0:17831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17831:1870604236166144:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1783947660.574355:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947660.574389:0:17831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac645fcc0 going to sleep for 11 seconds 00002000:00010000:0.0:1783947660.576340:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.576353:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.576384:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.576389:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.576396:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.576415:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.576425:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.576432:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.577031:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947660.578304:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.578316:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.578333:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.578338:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.578345:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.578359:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.578382:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.578390:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.578419:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783947660.578432:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947660.578443:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578490:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947660.578495:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578505:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578525:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578533:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501685 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578557:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947660.578561:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578567:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947660.578569:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578576:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578584:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578595:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550168c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.578606:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.578608:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.578610:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947660.578829:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166144 00000100:00100000:1.0:1783947660.578842:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166144 00000100:00100000:1.0:1783947660.578899:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783947660.578909:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17831:x1870604236166144:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1783947660.578956:0:18594:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1783947660.581337:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.581348:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.581365:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.581370:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.581377:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.581392:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.581403:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.581412:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.581445:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947660.582731:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.582743:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.583218:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.583223:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.583230:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.583245:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.583255:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.583263:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.583276:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783947660.584745:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783947660.584760:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584772:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947660.584777:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584789:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584815:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584823:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd33b3fb/0xe6fd1fdb55501693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584854:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947660.584858:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584879:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947660.584882:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584889:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584898:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584904:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f14b9312/0xe6fd1fdb5550169a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.584915:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.584916:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.584918:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947660.589917:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.589932:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.589951:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.589964:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.589971:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.589988:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.589999:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.590007:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.590031:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947660.590181:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947660.590191:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.590202:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947660.590207:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.590218:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.590246:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.590254:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4aec4e6/0xe6fd1fdb555016a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.590276:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.590278:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.590280:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.590335:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947660.606260:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.606274:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.606292:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.606297:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.606305:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.606321:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.606331:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.606349:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.606368:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947660.608178:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947660.608193:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.608208:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97a00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947660.608213:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.608227:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.608251:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.608260:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087ff5167/0xe6fd1fdb555016a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783947660.608282:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.608290:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.608292:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.608293:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.608296:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.608307:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.608312:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.608318:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.608331:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.608341:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.608349:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.608373:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947660.611346:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.611361:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.611386:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.611391:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.611398:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.611414:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.611425:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.611433:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.611469:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783947660.611612:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947660.611623:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611633:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.611638:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611647:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611682:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611696:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0764e2/0xe6fd1fdb555016af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611716:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947660.611720:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611727:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.611731:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611738:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611749:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611756:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000026790c8/0xe6fd1fdb555016b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.611771:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.611772:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.611774:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947660.613187:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.613200:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.613215:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.613220:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.613225:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.613237:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.613256:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.613264:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.613290:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947660.614486:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947660.614501:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.614515:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947660.614520:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.614531:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.614557:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.614565:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b60c2b8/0xe6fd1fdb555016bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.614608:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947660.614610:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947660.614612:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947660.614742:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947660.626739:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.626754:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.626774:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.626778:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.626785:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.626800:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.626811:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.626819:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.626858:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783947660.629117:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.629128:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629145:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.629150:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.629156:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629170:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629180:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629187:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629215:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783947660.629573:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.629580:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629589:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.629598:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.629603:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629613:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783947660.629615:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629623:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629627:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629660:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97800 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.629666:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629677:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629696:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629703:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088998405/0xe6fd1fdb555016c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629716:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.629729:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783947660.629735:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947660.629740:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629748:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.629752:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629760:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629771:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629785:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb555016cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629799:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947660.629802:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629809:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.629812:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629820:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629831:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629838:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb555016d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.629850:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.629852:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.629854:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947660.633852:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.634601:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.634611:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.634627:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.634633:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.634640:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.634668:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.634678:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.634686:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.634704:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947660.635119:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947660.635128:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.635145:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.635149:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.635159:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.635178:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.635186:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e6bb056/0xe6fd1fdb555016d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.635208:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.635210:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.635212:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783947660.636451:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783947660.636481:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.636498:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=545s v=(0 0) 00010000:00010000:2.0:1783947660.636503:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947660.636524:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.636548:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.636567:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.636575:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.636594:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.637369:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.637379:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.637389:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5fc00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.637394:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.637404:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.637425:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.637444:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052decbc7/0xe6fd1fdb555016e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.637486:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.637488:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.637490:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.639343:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.639355:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.639385:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.639390:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.639397:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.639410:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.639419:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.639427:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.639453:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.639769:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.639777:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.639786:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.639791:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.639799:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.639816:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.639823:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098518106/0xe6fd1fdb555016e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.639844:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.639846:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.639847:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.640004:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.640010:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.640018:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.640022:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.640026:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.640035:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.640057:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.640064:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.640084:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.640225:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.640230:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.640238:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.640241:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.640248:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.640259:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.640267:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8f93c80/0xe6fd1fdb555016ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.640281:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.640283:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.640284:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.641328:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.641339:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.641353:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.641357:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.641362:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.641376:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.641385:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.641393:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.641428:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947660.641812:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947660.641822:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.641832:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.641837:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.641846:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.641862:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.641870:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bdc1ec2/0xe6fd1fdb555016f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.641890:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.641899:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.641901:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.643608:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.643621:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.643636:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.643640:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.643645:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.643668:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.643677:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.643685:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.643707:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783947660.644833:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947660.644845:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.644857:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50a00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.644862:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.644873:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.644892:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.644899:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027ed5108/0xe6fd1fdb555016fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.644932:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.644934:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.644936:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.645572:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.645582:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.645594:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.645606:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.645612:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.645626:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.645636:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.645643:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.645672:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783947660.646620:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.646629:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.646640:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.646644:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.646657:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.646669:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.646679:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.646693:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.646707:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783947660.646886:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947660.646894:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.646903:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.646907:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.646936:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.646953:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.647116:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8ec33da/0xe6fd1fdb55501703 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.647141:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947660.647145:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.647152:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50000 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:2.0:1783947660.647155:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.647163:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.647174:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.647181:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086432c47/0xe6fd1fdb5550170a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947660.647209:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.647211:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.647214:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947660.647223:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.647675:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.647684:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.647695:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.647700:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.647705:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.647715:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.647723:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.647730:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.647754:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.648400:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.648409:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.648417:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.648421:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.648442:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.648481:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.648489:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008afb3714/0xe6fd1fdb55501711 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.648509:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.648511:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.648512:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.648979:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.648985:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.649002:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.649006:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.649011:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.649022:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.649031:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.649038:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.649685:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.650078:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.650087:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650098:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e50e00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.650103:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650111:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650129:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650160:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000638cfbcb/0xe6fd1fdb55501718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650181:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.650185:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.650188:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.650499:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.650507:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.650515:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.650519:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.650524:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.650533:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.650551:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.650558:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.650574:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.650844:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.650850:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650857:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.650860:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650868:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650878:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650885:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654422fd/0xe6fd1fdb5550171f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.650899:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.650901:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.650903:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.653788:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.653801:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.653819:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.653824:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.653831:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.653844:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.653854:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.653862:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.653891:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.655019:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.655031:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.655043:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9a200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.655048:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.655066:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.655086:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.655095:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000609bbc/0xe6fd1fdb55501726 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.655118:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.655120:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.655122:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947660.656913:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.656928:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.656945:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.656951:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.656958:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.656987:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.656997:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.657005:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.657024:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.657036:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.657041:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.657049:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.657054:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.657713:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.657733:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.657741:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009751d7a8/0xe6fd1fdb5550172d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.657767:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.657769:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.657771:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783947660.658257:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783947660.658264:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658274:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1783947660.658278:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783947660.658284:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658295:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658303:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658311:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658328:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783947660.658337:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.658343:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658362:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97c00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.658366:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658374:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658386:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658393:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b26a39f/0xe6fd1fdb55501734 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.658407:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.658408:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.658410:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783947660.659693:0:19409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1783947660.659727:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1783947660.659731:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783947660.660107:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17831:x1870604236166144:12345-0@lo:5:osp-pre-1-1.0 Request processed in 81196us (85748us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783947660.660120:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783947660.660326:0:17831:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783947660.660336:0:17831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17831:1870604236166144:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783947660.660353:0:17831:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1783947660.660412:0:17831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17831:1870604236166272:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783947660.660451:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947660.660494:0:17831:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac77f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783947660.660631:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166272 00000100:00100000:2.0:1783947660.660640:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166272 00000100:00100000:2.0:1783947660.661056:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783947660.661067:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17831:x1870604236166272:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783947660.661134:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17831:x1870604236166272:12345-0@lo:900:osp-pre-1-1.0 Request processed in 69us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947660.661140:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783947660.661342:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5841180 x1870604236166272/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783947676 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947660.661392:0:17831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17831:1870604236166272:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1783947660.669210:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.669226:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.669244:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.669249:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.669256:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.669270:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.669280:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.669288:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.669306:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783947660.669472:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783947660.669481:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.669492:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846bc00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:1.0:1783947660.669498:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.669508:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.669526:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.669534:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a7a5ee/0xe6fd1fdb5550173b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947660.669554:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947660.669556:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783947660.669558:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783947660.673086:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783947660.673102:0:18593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.673127:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=545s v=(0 0) 00010000:00010000:3.0:1783947660.673131:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947660.673138:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.673153:0:18593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.673164:0:18593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.673172:0:18593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947660.673188:0:18593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783947660.673274:0:18593:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1783947660.673373:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17114:x1870604236165632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 137753us (139131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947660.673384:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783947660.673449:0:17114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7500380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1870604236165632:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783947660.673489:0:17114:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1783947660.673536:0:17114:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1870604236166400:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783947660.673574:0:17114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947660.673598:0:17114:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bfcba6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783947660.673626:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166400 00000100:00100000:3.0:1783947660.673632:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166400 00000100:00100000:3.0:1783947660.673686:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947660.673695:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17114:x1870604236166400:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783947660.673733:0:19073:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1783947660.677909:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17114:x1870604236166400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4208us (4327us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783947660.677922:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947660.678230:0:17114:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc942b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17114:1870604236166400:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783947660.678245:0:17114:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1783947660.678333:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783947660.678342:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.678354:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b600 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:0.0:1783947660.678359:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.678371:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.678391:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.678398:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947660.678420:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.678421:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947660.678423:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783947661.049880:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783947661.467579:0:19778:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg403-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1783947661.493113:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783947662.068947:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783947662.858820:0:19831:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783947662.859142:0:19831:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783947663.091968:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783947663.604717:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236166528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947663.604822:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947663.604890:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947663.604897:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236166656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947663.604921:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947663.604959:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166528 00000100:00100000:0.0:1783947663.604969:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166528 00000100:00100000:0.0:1783947663.605013:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166656 00000100:00100000:0.0:1783947663.605016:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166656 00000100:00100000:0.0:1783947663.605035:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947663.605044:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236166528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783947663.605082:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783947663.605129:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236166528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947663.605136:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783947663.605154:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947663.605160:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236166656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947663.605176:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947663.605203:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236166656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947663.605209:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783947663.605261:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236166656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947663.605273:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236166528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783947663.607755:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236166784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947663.607827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947663.607862:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783947663.607868:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236166912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947663.607891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947663.607923:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166784 00000100:00100000:1.0:1783947663.607931:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166784 00000100:00100000:1.0:1783947663.607974:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236166912 00000100:00100000:1.0:1783947663.607977:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236166912 00000100:00100000:1.0:1783947663.607996:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947663.608003:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236166784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947663.608031:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947663.608074:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236166784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947663.608080:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783947663.608097:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783947663.608103:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236166912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947663.608112:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947663.608137:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236166912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947663.608143:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1783947663.608163:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947663.608199:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236166912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947663.608213:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8621180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236166784:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1783947663.689889:0:19881:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783947663.690118:0:19881:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783947664.012039:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947664.012099:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061056 00000100:00100000:0.0:1783947664.012112:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061056 00000100:00100000:0.0:1783947664.012167:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:0.0:1783947664.012176:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2405:x1870604214061056:12345-192.168.204.3@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783947664.012207:0:17081:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from a84253a8-4830-4b12-9d0f-3006cd9f4d80@192.168.204.3@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1783947664.012250:0:17081:0:(genops.c:1406:class_connect()) connect: client a84253a8-4830-4b12-9d0f-3006cd9f4d80, cookie 0xe6fd1fdb55501749 00000100:00080000:0.0:1783947664.012382:0:17081:0:(import.c:65:import_set_state_nolock()) ffff9e7bf7a8a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783947664.012484:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+5:2405:x1870604214061056:12345-192.168.204.3@tcp:250:mount.lustre.0 Request processed in 307us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947664.012493:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 114 00000100:00100000:1.0:1783947664.033876:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.035472:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061184 00000100:00100000:2.0:1783947664.035495:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061184 00000100:00100000:2.0:1783947664.035664:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:2.0:1783947664.035679:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+5:14905:x1870604214061184:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947664.035706:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947664.035732:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f000/0xe6fd1fdb55501750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4259 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.035792:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f000/0xe6fd1fdb55501750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4259 expref: 6 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.035808:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5f000/0xe6fd1fdb55501750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4259 expref: 6 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.035822:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f000, rc 0) 00000100:00100000:2.0:1783947664.035928:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+6:14905:x1870604214061184:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 254us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.035936:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 115 00000100:00100000:3.0:1783947664.043267:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.043840:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061312 00000100:00100000:2.0:1783947664.043856:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061312 00000100:00100000:2.0:1783947664.043947:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:2.0:1783947664.043961:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+6:14905:x1870604214061312:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783947664.044154:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+6:14905:x1870604214061312:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 196us (902us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783947664.044164:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 116 00000100:00100000:3.0:1783947664.049326:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.050808:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061440 00000100:00100000:2.0:1783947664.050834:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061440 00000100:00100000:2.0:1783947664.051328:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:2.0:1783947664.051344:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+6:14905:x1870604214061440:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947664.051371:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947664.051399:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb55501757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4260 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.051439:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb55501757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4260 expref: 7 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.051798:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5f800/0xe6fd1fdb55501757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4260 expref: 7 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.051811:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f800, rc 0) 00000100:00100000:2.0:1783947664.053526:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+7:14905:x1870604214061440:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 2168us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.053542:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 117 00000100:00100000:1.0:1783947664.063563:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947664.063663:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061568 00000100:00100000:0.0:1783947664.063677:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061568 00000100:00100000:0.0:1783947664.063763:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:0.0:1783947664.063776:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+7:14905:x1870604214061568:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783947664.064021:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14905:x1870604214061568:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 247us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947664.064031:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 118 00000100:00100000:3.0:1783947664.075604:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.077098:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061696 00000100:00100000:2.0:1783947664.077116:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061696 00000100:00100000:2.0:1783947664.077207:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:2.0:1783947664.077220:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14905:x1870604214061696:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947664.077440:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14905:x1870604214061696:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 223us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.077450:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 119 00000100:00100000:3.0:1783947664.088353:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.088977:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061824 00000100:00100000:2.0:1783947664.088994:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061824 00000100:00100000:2.0:1783947664.089090:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:2.0:1783947664.089103:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14924:x1870604214061824:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947664.089323:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14924:x1870604214061824:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 222us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.089333:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 120 00000100:00100000:1.0:1783947664.114940:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.115623:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214061952 00000100:00100000:2.0:1783947664.115639:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214061952 00000100:00100000:2.0:1783947664.115793:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 121 00000100:00100000:2.0:1783947664.115806:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14924:x1870604214061952:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947664.116171:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc51c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14924:x1870604214061952:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 366us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.116184:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 121 00010000:00010000:1.0:1783947664.116372:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947664.127094:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947664.127251:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062080 00000100:00100000:0.0:1783947664.127264:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062080 00000100:00100000:0.0:1783947664.127341:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:0.0:1783947664.127354:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd554b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14924:x1870604214062080:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947664.127609:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd554b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14924:x1870604214062080:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 256us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947664.127617:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 122 00000100:00100000:3.0:1783947664.131257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947664.132910:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062208 00000100:00100000:0.0:1783947664.132929:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062208 00000100:00100000:0.0:1783947664.133031:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:0.0:1783947664.133045:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd554a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+8:14905:x1870604214062208:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947664.133079:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947664.133106:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb5550175e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4291 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947664.133168:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb5550175e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4291 expref: 9 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947664.133181:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96000/0xe6fd1fdb5550175e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4291 expref: 9 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947664.133193:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96000, rc 0) 00000100:00100000:0.0:1783947664.133276:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd554a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+9:14905:x1870604214062208:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 233us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947664.133284:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 123 00000100:00100000:1.0:1783947664.137801:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.137910:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062336 00000100:00100000:2.0:1783947664.137923:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062336 00000100:00100000:2.0:1783947664.137996:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:2.0:1783947664.138007:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd5549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+9:14905:x1870604214062336:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783947664.138043:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783947664.138082:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783947664.138086:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783947664.138089:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783947664.138092:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783947664.138095:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1783947664.140138:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd5549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+9:14905:x1870604214062336:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 2057us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.140157:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 124 00000100:00100000:3.0:1783947664.143630:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.143910:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062464 00000100:00100000:2.0:1783947664.143923:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062464 00000100:00100000:2.0:1783947664.143999:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:2.0:1783947664.144012:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bd5548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+9:14905:x1870604214062464:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947664.144039:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947664.144076:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4298 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.144280:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.144323:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947664.144335:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947664.144412:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bd5548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14905:x1870604214062464:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 403us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.144428:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 125 00000100:00100000:1.0:1783947664.147159:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.147365:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062592 00000100:00100000:2.0:1783947664.147379:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062592 00000100:00100000:2.0:1783947664.147504:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:2.0:1783947664.147517:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bff948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14905:x1870604214062592:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783947664.147743:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bff948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14905:x1870604214062592:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 228us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.147753:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 126 00000100:00100000:3.0:1783947664.150854:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.150980:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062720 00000100:00100000:2.0:1783947664.150993:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062720 00000100:00100000:2.0:1783947664.151125:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:2.0:1783947664.151139:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bff949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14905:x1870604214062720:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947664.151344:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bff949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14905:x1870604214062720:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 208us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.151353:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 127 00000100:00100000:3.0:1783947664.158234:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947664.159313:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062848 00000100:00100000:0.0:1783947664.159331:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062848 00000100:00100000:0.0:1783947664.159592:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:0.0:1783947664.159607:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14929:x1870604214062848:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947664.159868:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14929:x1870604214062848:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 263us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947664.159878:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 128 00000100:00100000:1.0:1783947664.177352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.177494:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214062976 00000100:00100000:2.0:1783947664.177508:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214062976 00000100:00100000:2.0:1783947664.177592:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:2.0:1783947664.177605:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14929:x1870604214062976:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947664.177932:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:14929:x1870604214062976:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 327us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.177941:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 129 00000100:00100000:1.0:1783947664.188574:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947664.188689:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.191875:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214063104 00000100:00100000:2.0:1783947664.191897:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214063104 00000100:00100000:2.0:1783947664.191966:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214063360 00000100:00100000:2.0:1783947664.191969:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214063360 00000100:00100000:2.0:1783947664.192010:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947664.192021:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1870604214063104:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783947664.192062:0:17089:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bc51fa7f-2744-43d7-9883-dba4b4b8d1ba@192.168.204.3@tcp t0 exp 0000000000000000 cur 549 last 0 00000100:00100000:1.0:1783947664.192209:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:1.0:1783947664.192217:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2405:x1870604214063360:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783947664.192239:0:17087:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from bc51fa7f-2744-43d7-9883-dba4b4b8d1ba@192.168.204.3@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:1.0:1783947664.192300:0:17087:0:(genops.c:1406:class_connect()) connect: client bc51fa7f-2744-43d7-9883-dba4b4b8d1ba, cookie 0xe6fd1fdb5550176c 00000004:00100000:1.0:1783947664.192336:0:17087:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783947664.192804:0:17087:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5823800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783947664.192901:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2405:x1870604214063360:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 682us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947664.192912:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000020:00000080:2.0:1783947664.193477:0:17089:0:(genops.c:1406:class_connect()) connect: client bc51fa7f-2744-43d7-9883-dba4b4b8d1ba, cookie 0xe6fd1fdb55501773 00000004:00100000:2.0:1783947664.193507:0:17089:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1783947664.198855:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947664.199525:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214063488 00000100:00100000:1.0:1783947664.199540:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214063488 00000100:00100000:1.0:1783947664.199662:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1783947664.199675:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:0:x1870604214063488:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783947664.199807:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783947664.199923:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:0:x1870604214063488:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 250us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947664.199931:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00080000:2.0:1783947664.200048:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947664.200094:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2405:x1870604214063104:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 8073us (11536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.200112:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00080000:0.0:1783947664.200893:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783947664.209189:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947664.209263:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947664.210697:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214063232 00000100:00100000:0.0:1783947664.210717:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214063232 00000100:00100000:1.0:1783947664.211033:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214063616 00000100:00100000:1.0:1783947664.211038:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214063616 00000100:00100000:1.0:1783947664.211069:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:1.0:1783947664.211081:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:0:x1870604214063232:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783947664.211202:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783947664.211618:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:0:x1870604214063232:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 537us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947664.211627:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:1.0:1783947664.211656:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1783947664.211664:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214063616:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783947664.211682:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783947664.211709:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214063616:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 47us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947664.211717:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00080000:0.0:1783947664.211949:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947664.218820:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947664.220034:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214063744 00000100:00100000:3.0:1783947664.220050:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214063744 00000100:00100000:3.0:1783947664.220211:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1783947664.220223:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214063744:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783947664.220350:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214063744:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 129us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947664.220360:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:1.0:1783947664.222998:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.223250:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064128 00000100:00100000:2.0:1783947664.223264:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064128 00000100:00100000:1.0:1783947664.225620:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947664.225798:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947664.226488:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214063872 00000100:00100000:3.0:1783947664.226504:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214063872 00000100:00100000:2.0:1783947664.226526:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1783947664.226554:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214064128:12345-192.168.204.3@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783947664.226566:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064000 00000100:00100000:3.0:1783947664.226573:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064000 00000100:00100000:3.0:1783947664.226617:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:3.0:1783947664.226628:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604214063872:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783947664.226855:0:18594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bc51fa7f-2744-43d7-9883-dba4b4b8d1ba@192.168.204.3@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:3.0:1783947664.226898:0:18594:0:(genops.c:1406:class_connect()) connect: client bc51fa7f-2744-43d7-9883-dba4b4b8d1ba, cookie 0xe6fd1fdb5550177a 00002000:00100000:3.0:1783947664.227171:0:18594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bc51fa7f-2744-43d7-9883-dba4b4b8d1ba/ffff9e7bf34cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783947664.227188:0:18594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783947664.227945:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214064128:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 1398us (4954us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947664.227958:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00002000:00080000:3.0:1783947664.228378:0:18594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783947664.228432:0:18594:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947664.228576:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2405:x1870604214063872:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 1948us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947664.228597:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:3.0:1783947664.228628:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1783947664.228635:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1870604214064000:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783947664.228677:0:18594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bc51fa7f-2744-43d7-9883-dba4b4b8d1ba@192.168.204.3@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:3.0:1783947664.228708:0:18594:0:(genops.c:1406:class_connect()) connect: client bc51fa7f-2744-43d7-9883-dba4b4b8d1ba, cookie 0xe6fd1fdb55501781 00002000:00100000:3.0:1783947664.228721:0:18594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bc51fa7f-2744-43d7-9883-dba4b4b8d1ba/ffff9e7bf34c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783947664.228850:0:18594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783947664.229006:0:18594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783947664.229025:0:18594:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34ce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947664.229307:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2405:x1870604214064000:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 669us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947664.229315:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:1.0:1783947664.239856:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947664.239994:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064256 00000100:00100000:0.0:1783947664.240006:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064256 00000100:00100000:0.0:1783947664.240620:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:0.0:1783947664.240633:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214064256:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783947664.246859:0:17090:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6118us 00000004:00200000:0.0:1783947664.278849:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783947664.278989:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14905:x1870604214064256:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 38354us (39136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947664.279000:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000040:00080000:1.0:1783947664.500338:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783947664.508678:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947664.511362:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064384 00000100:00100000:2.0:1783947664.511379:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064384 00000100:00100000:2.0:1783947664.511681:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1783947664.512119:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:14952:x1870604214064384:12345-192.168.204.3@tcp:101:mkdir.0 00010000:00010000:3.0:1783947664.512722:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947664.512863:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e42c9 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947664.512956:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb5550178f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947664.512972:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb5550178f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947664.512986:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb5550178f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947664.513047:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783947664.513051:0:17087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947664.513099:0:17087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb5550178f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947664.515674:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846be00/0xe6fd1fdb55501788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e42c9 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947664.515712:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb5550178f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e42c9 expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947664.515723:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:3.0:1783947664.515725:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783947664.515729:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846ac00, rc 0) 00000100:00100000:3.0:1783947664.515827:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:14952:x1870604214064384:12345-192.168.204.3@tcp:101:mkdir.0 Request processed in 4122us (7168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947664.515854:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00010000:00010000:0.0:1783947665.140902:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947665.651865:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783947665.651889:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236167040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783947665.651964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947665.652030:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167040 00000100:00100000:1.0:1783947665.652037:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167040 00000100:00100000:1.0:1783947665.652103:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783947665.652112:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236167040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947665.652141:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783947665.652186:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1870604236167040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947665.652194:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1783947665.652214:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783947665.652251:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236167040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947665.656743:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236167296:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.656816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.656859:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236167808:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.656885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.656904:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236168320:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.656928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.656952:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783947665.656957:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236167424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.656983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.656999:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236167936:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.657032:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236168448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.657079:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167296 00000100:00100000:3.0:1783947665.657085:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167296 00000100:00100000:3.0:1783947665.657130:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783947665.657139:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236167296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657196:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236167296:12345-0@lo:400:kworker.0 Request processed in 58us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.657203:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783947665.657224:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167808 00000100:00100000:3.0:1783947665.657228:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167808 00000100:00100000:3.0:1783947665.657258:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167424 00000100:00100000:3.0:1783947665.657261:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167424 00000100:00100000:3.0:1783947665.657294:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167936 00000100:00100000:3.0:1783947665.657296:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167936 00000100:00100000:3.0:1783947665.657309:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947665.657315:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236167808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657347:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236167808:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.657352:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783947665.657415:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947665.657421:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236167424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657449:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236167424:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.657486:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783947665.657497:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947665.657503:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236167936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657546:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236167936:12345-0@lo:400:kworker.0 Request processed in 43us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.657565:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783947665.657586:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168320 00000100:00100000:3.0:1783947665.657590:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168320 00000100:00100000:3.0:1783947665.657615:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168448 00000100:00100000:3.0:1783947665.657617:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168448 00000100:00100000:3.0:1783947665.657633:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947665.657639:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236168320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657667:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236168320:12345-0@lo:400:kworker.0 Request processed in 29us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.657673:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783947665.657684:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783947665.657697:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236168448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657725:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1870604236168448:12345-0@lo:400:kworker.0 Request processed in 29us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.657731:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1783947665.657787:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947665.657792:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947665.657794:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947665.657796:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947665.657808:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236167168:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.657867:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236167680:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657891:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.657906:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236168192:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.657944:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783947665.657950:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236167552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.657968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.657983:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236168064:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.658008:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236168576:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947665.658046:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168192 00000100:00100000:3.0:1783947665.658049:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168192 00000100:00100000:3.0:1783947665.658072:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167552 00000100:00100000:3.0:1783947665.658075:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167552 00000100:00100000:3.0:1783947665.658088:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168064 00000100:00100000:3.0:1783947665.658090:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168064 00000100:00100000:3.0:1783947665.658110:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168576 00000100:00100000:3.0:1783947665.658114:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168576 00000100:00100000:3.0:1783947665.658129:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947665.658135:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236168192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658170:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236168192:12345-0@lo:400:kworker.0 Request processed in 36us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.658176:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783947665.658189:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783947665.658194:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236167552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658220:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1870604236167552:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.658226:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783947665.658237:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783947665.658243:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236168064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658266:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1870604236168064:12345-0@lo:400:kworker.0 Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.658272:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783947665.658282:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783947665.658287:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236168576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658309:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1870604236168576:12345-0@lo:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947665.658314:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1783947665.658326:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947665.658328:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947665.658359:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236167424:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658370:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236167936:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658391:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1870604236168448:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658405:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236167296:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658414:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236167808:0@lo:400:kworker.0 00010000:00080000:3.0:1783947665.658425:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d68000 x1870604236168320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947665.658435:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236168320:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658497:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1870604236167552:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658506:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1870604236168064:0@lo:400:kworker.0 00010000:00080000:3.0:1783947665.658515:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d68380 x1870604236168576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947665.658524:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1870604236168576:0@lo:400:kworker.0 00000100:00100000:3.0:1783947665.658534:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236168192:0@lo:400:kworker.0 00000100:00100000:0.0:1783947665.658656:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167680 00000100:00100000:0.0:1783947665.658660:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167680 00000100:00100000:0.0:1783947665.658694:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783947665.658701:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236167680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947665.658742:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236167680:12345-0@lo:400:kworker.0 Request processed in 41us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947665.658747:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783947665.658771:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236167680:0@lo:400:kworker.0 00000100:00100000:0.0:1783947665.658788:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236167168 00000100:00100000:0.0:1783947665.658791:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236167168 00000100:00100000:0.0:1783947665.658823:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947665.658829:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3638:x1870604236167168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947665.658863:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3638:x1870604236167168:12345-0@lo:400:kworker.0 Request processed in 34us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947665.658870:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783947665.658901:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236167168:0@lo:400:kworker.0 00000100:00100000:1.0:1783947665.661481:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783947665.661505:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236168704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947665.661601:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947665.661675:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168704 00000100:00100000:1.0:1783947665.661682:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168704 00000100:00100000:1.0:1783947665.661725:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947665.661734:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236168704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783947665.661756:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783947665.661800:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236168704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947665.661808:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947665.661854:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac8622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236168704:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783947666.163828:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783947666.680158:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000001:00080000:3.0:1783947666.680176:0:19409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1783947666.699062:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947666.699263:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064512 00000100:00100000:3.0:1783947666.699282:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064512 00000100:00100000:3.0:1783947666.699509:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:3.0:1783947666.699522:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15004:x1870604214064512:12345-192.168.204.3@tcp:41:lfs.0 00000004:00000024:3.0:1783947666.699597:0:17089:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783947666.699736:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15004:x1870604214064512:12345-192.168.204.3@tcp:41:lfs.0 Request processed in 216us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947666.699780:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00080000:0.0:1783947666.703308:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947666.711737:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947666.711954:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064640 00000100:00100000:3.0:1783947666.711967:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064640 00000100:00080000:0.0:1783947666.712064:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783947666.712087:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:3.0:1783947666.712112:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:15004:x1870604214064640:12345-192.168.204.3@tcp:41:lfs.0 00000004:00000024:3.0:1783947666.712175:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947666.712306:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:15004:x1870604214064640:12345-192.168.204.3@tcp:41:lfs.0 Request processed in 208us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947666.712316:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:2.0:1783947666.722283:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947666.722380:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064768 00000100:00100000:1.0:1783947666.722396:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064768 00000100:00100000:1.0:1783947666.722565:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:1.0:1783947666.722578:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:15004:x1870604214064768:12345-192.168.204.3@tcp:13:lfs.0 00002000:00000024:1.0:1783947666.722644:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947666.722779:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:15004:x1870604214064768:12345-192.168.204.3@tcp:13:lfs.0 Request processed in 204us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947666.722788:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00080000:0.0:1783947666.722880:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947666.726549:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947666.726886:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214064896 00000100:00100000:3.0:1783947666.726901:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214064896 00000100:00080000:0.0:1783947666.727066:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947666.727175:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1783947666.727190:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15004:x1870604214064896:12345-192.168.204.3@tcp:13:lfs.0 00002000:00000024:3.0:1783947666.727244:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783947666.727365:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15004:x1870604214064896:12345-192.168.204.3@tcp:13:lfs.0 Request processed in 178us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947666.727373:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:3.0:1783947666.981700:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947666.981888:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065024 00000100:00100000:2.0:1783947666.981902:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065024 00000100:00100000:2.0:1783947666.981983:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:2.0:1783947666.981997:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+10:15037:x1870604214065024:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947666.982033:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947666.982059:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb55501796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e42d0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947666.985263:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb55501796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e42d0 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947666.985277:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5f400/0xe6fd1fdb55501796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e42d0 expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947666.985287:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f400, rc 0) 00000100:00100000:2.0:1783947666.985474:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15037:x1870604214065024:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 3465us (3773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947666.985484:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 131 00000100:00100000:0.0:1783947666.990183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947666.990306:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065152 00000100:00100000:2.0:1783947666.990317:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065152 00000100:00100000:2.0:1783947666.990409:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:2.0:1783947666.990420:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc3289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15037:x1870604214065152:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783947666.990730:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc3289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15037:x1870604214065152:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 310us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947666.990738:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 132 00000100:00100000:1.0:1783947666.999407:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.000382:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065280 00000100:00100000:2.0:1783947667.000394:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065280 00000100:00100000:2.0:1783947667.000491:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:2.0:1783947667.000502:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15037:x1870604214065280:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783947667.000993:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15037:x1870604214065280:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 491us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.001002:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 133 00000100:00100000:3.0:1783947667.009171:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.009928:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065408 00000100:00100000:2.0:1783947667.009939:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065408 00000100:00100000:2.0:1783947667.010006:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:2.0:1783947667.010027:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15043:x1870604214065408:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947667.010192:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15043:x1870604214065408:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 168us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.010199:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 134 00000100:00100000:0.0:1783947667.050789:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.051106:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065536 00000100:00100000:2.0:1783947667.051286:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065536 00000100:00100000:2.0:1783947667.051413:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:2.0:1783947667.051429:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15043:x1870604214065536:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783947667.051729:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15043:x1870604214065536:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 302us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.051739:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 135 00000100:00100000:1.0:1783947667.062631:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.064518:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065664 00000100:00100000:0.0:1783947667.064549:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065664 00000100:00100000:0.0:1783947667.064660:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:0.0:1783947667.064674:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15043:x1870604214065664:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947667.065000:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15043:x1870604214065664:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 329us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.065091:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 136 00000100:00100000:3.0:1783947667.078742:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.079383:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065792 00000100:00100000:2.0:1783947667.079399:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065792 00000100:00100000:2.0:1783947667.079538:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:2.0:1783947667.079553:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:15037:x1870604214065792:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783947667.079602:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947667.079630:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5ee00/0xe6fd1fdb5550179d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4301 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947667.079688:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5ee00/0xe6fd1fdb5550179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4301 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947667.079705:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5ee00/0xe6fd1fdb5550179d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4301 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947667.079719:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ee00, rc 0) 00000100:00100000:2.0:1783947667.079797:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:15037:x1870604214065792:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 248us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.079806:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 137 00000100:00100000:1.0:1783947667.086006:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.086236:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214065920 00000100:00100000:2.0:1783947667.086251:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214065920 00000100:00100000:2.0:1783947667.086330:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:2.0:1783947667.086343:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:15037:x1870604214065920:12345-192.168.204.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783947667.086383:0:17081:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783947667.086417:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783947667.086423:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783947667.086427:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783947667.086430:0:17081:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783947667.086432:0:17081:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1783947667.089826:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:15037:x1870604214065920:12345-192.168.204.3@tcp:256:mount.lustre.0 Request processed in 3467us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.089848:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 138 00000100:00100000:1.0:1783947667.097290:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.099978:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066048 00000100:00100000:0.0:1783947667.099998:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066048 00000100:00100000:0.0:1783947667.100102:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:0.0:1783947667.100115:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc411b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:15037:x1870604214066048:12345-192.168.204.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783947667.100140:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947667.100167:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4308 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.100211:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.100225:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.100238:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:0.0:1783947667.100348:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc411b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15037:x1870604214066048:12345-192.168.204.3@tcp:101:mount.lustre.0 Request processed in 235us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.100378:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 139 00000100:00100000:1.0:1783947667.105868:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.106004:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066176 00000100:00100000:2.0:1783947667.106047:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066176 00000100:00100000:2.0:1783947667.106136:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:2.0:1783947667.106149:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15037:x1870604214066176:12345-192.168.204.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783947667.106374:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15037:x1870604214066176:12345-192.168.204.3@tcp:501:mount.lustre.0 Request processed in 226us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.106384:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 140 00000100:00100000:1.0:1783947667.118181:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947667.118323:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066304 00000100:00100000:3.0:1783947667.118336:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066304 00000100:00100000:3.0:1783947667.118420:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:3.0:1783947667.118434:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15037:x1870604214066304:12345-192.168.204.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783947667.118974:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15037:x1870604214066304:12345-192.168.204.3@tcp:503:mount.lustre.0 Request processed in 539us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.118986:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 141 00000100:00100000:1.0:1783947667.125537:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.125910:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066432 00000100:00100000:0.0:1783947667.125924:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066432 00000100:00100000:0.0:1783947667.126003:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:0.0:1783947667.126014:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc4da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15047:x1870604214066432:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947667.126225:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc4da3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15047:x1870604214066432:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 213us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.126234:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 142 00000100:00100000:1.0:1783947667.129703:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.129825:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066560 00000100:00100000:0.0:1783947667.129839:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066560 00000100:00100000:0.0:1783947667.129925:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:0.0:1783947667.129937:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15047:x1870604214066560:12345-192.168.204.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783947667.130285:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:15047:x1870604214066560:12345-192.168.204.3@tcp:502:llog_process_th.0 Request processed in 341us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.130295:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 143 00000100:00100000:1.0:1783947667.147082:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947667.147183:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947667.148321:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066688 00000100:00100000:3.0:1783947667.148359:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066688 00000100:00100000:3.0:1783947667.148419:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066816 00000100:00100000:3.0:1783947667.148423:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066816 00000100:00100000:1.0:1783947667.148454:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947667.148511:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947667.148515:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1783947667.148542:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:2408:x1870604214066816:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947667.148552:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947667.148583:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947667.148661:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:2408:x1870604214066816:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 133us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947667.148670:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1783947667.148689:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214066944 00000100:00100000:3.0:1783947667.148693:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214066944 00000100:00100000:3.0:1783947667.148707:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067456 00000100:00100000:3.0:1783947667.148709:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067456 00000100:00100000:3.0:1783947667.148720:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947667.148725:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2408:x1870604214066944:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947667.148753:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2408:x1870604214066944:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947667.148759:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:3.0:1783947667.148772:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:3.0:1783947667.148777:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1870604214066688:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783947667.148815:0:17089:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e@192.168.204.3@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:3.0:1783947667.148866:0:17089:0:(genops.c:1406:class_connect()) connect: client 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e, cookie 0xe6fd1fdb555017ab 00000004:00100000:3.0:1783947667.149107:0:17089:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783947667.149245:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9e7bf34cb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947667.149289:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2405:x1870604214066688:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 510us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947667.149298:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:3.0:1783947667.149327:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1783947667.149333:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1870604214067456:12345-192.168.204.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783947667.149355:0:17089:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e@192.168.204.3@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:3.0:1783947667.149382:0:17089:0:(genops.c:1406:class_connect()) connect: client 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e, cookie 0xe6fd1fdb555017b2 00000004:00100000:3.0:1783947667.149398:0:17089:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1783947667.149491:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9e7c01bf4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783947667.149545:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2405:x1870604214067456:12345-192.168.204.3@tcp:38:mount.lustre.0 Request processed in 210us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947667.149553:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1783947667.149590:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067072 00000100:00100000:3.0:1783947667.149596:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067072 00000100:00100000:3.0:1783947667.149634:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067200 00000100:00100000:3.0:1783947667.149638:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067200 00000100:00100000:3.0:1783947667.149668:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:2.0:1783947667.149684:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1783947667.149699:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214067200:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947667.149735:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214067200:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 41us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.149742:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:3.0:1783947667.151678:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2408:x1870604214067072:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947667.153539:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2408:x1870604214067072:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 3840us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.153562:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:1.0:1783947667.162369:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947667.162620:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067584 00000100:00100000:3.0:1783947667.162634:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067584 00000100:00100000:3.0:1783947667.162736:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:3.0:1783947667.162748:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:0:x1870604214067584:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783947667.162806:0:17089:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947667.162938:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:0:x1870604214067584:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 190us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947667.162948:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00080000:0.0:1783947667.163944:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947667.164785:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.164825:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.164923:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067328 00000100:00100000:0.0:1783947667.164934:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067328 00000100:00100000:1.0:1783947667.165203:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067712 00000100:00100000:1.0:1783947667.165208:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067712 00000100:00100000:1.0:1783947667.165285:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1783947667.165296:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+7:15037:x1870604214067712:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783947667.165349:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947667.165374:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:0.0:1783947667.165382:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+7:0:x1870604214067328:12345-192.168.204.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783947667.165396:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947667.165442:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+7:0:x1870604214067328:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 57us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.165490:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00080000:3.0:1783947667.165595:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947667.166108:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15037:x1870604214067712:12345-192.168.204.3@tcp:41:mount.lustre.0 Request processed in 772us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947667.166148:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:1.0:1783947667.169978:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947667.170152:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067840 00000100:00100000:2.0:1783947667.170163:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067840 00000100:00100000:2.0:1783947667.170227:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1783947667.170239:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15037:x1870604214067840:12345-192.168.204.3@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783947667.171791:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15037:x1870604214067840:12345-192.168.204.3@tcp:40:mount.lustre.0 Request processed in 1542us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.171805:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1783947667.181042:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.181152:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947667.188227:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.189051:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068224 00000100:00100000:0.0:1783947667.189063:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068224 00000100:00100000:0.0:1783947667.189142:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1783947667.189154:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15037:x1870604214068224:12345-192.168.204.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783947667.189243:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15037:x1870604214068224:12345-192.168.204.3@tcp:900:mount.lustre.0 Request processed in 91us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.189251:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:2.0:1783947667.194876:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214067968 00000100:00100000:2.0:1783947667.194892:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214067968 00000100:00100000:2.0:1783947667.194975:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068096 00000100:00100000:2.0:1783947667.194979:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068096 00000100:00100000:2.0:1783947667.195006:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1783947667.195014:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1870604214067968:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783947667.195051:0:18593:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e@192.168.204.3@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1783947667.195085:0:18593:0:(genops.c:1406:class_connect()) connect: client 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e, cookie 0xe6fd1fdb555017b9 00002000:00100000:2.0:1783947667.195097:0:18593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e/ffff9e7ac5bc5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783947667.195108:0:18593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783947667.195192:0:18593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783947667.195224:0:18593:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947667.195300:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2405:x1870604214067968:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 285us (14268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.195309:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1783947667.195331:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:2.0:1783947667.195336:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2405:x1870604214068096:12345-192.168.204.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783947667.195352:0:18593:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e@192.168.204.3@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1783947667.195369:0:18593:0:(genops.c:1406:class_connect()) connect: client 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e, cookie 0xe6fd1fdb555017c0 00002000:00100000:2.0:1783947667.195375:0:18593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e/ffff9e7ac5bc0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783947667.195382:0:18593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783947667.195432:0:18593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783947667.195487:0:18593:0:(import.c:65:import_set_state_nolock()) ffff9e7ac5bc0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783947667.195513:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2405:x1870604214068096:12345-192.168.204.3@tcp:8:mount.lustre.0 Request processed in 175us (14360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947667.195521:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00010000:00010000:0.0:1783947667.196991:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783947667.207644:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.208300:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068352 00000100:00100000:0.0:1783947667.208315:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068352 00000100:00100000:0.0:1783947667.208388:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:0.0:1783947667.208400:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15037:x1870604214068352:12345-192.168.204.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783947667.208610:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783947667.208746:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15037:x1870604214068352:12345-192.168.204.3@tcp:33:mount.lustre.0 Request processed in 348us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.208755:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:2.0:1783947667.410257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947667.410336:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068480 00000100:00100000:0.0:1783947667.410347:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068480 00000100:00100000:0.0:1783947667.410419:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:0.0:1783947667.410550:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15070:x1870604214068480:12345-192.168.204.3@tcp:101:mkdir.0 00010000:00010000:0.0:1783947667.410581:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947667.410615:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555017c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4339 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.410790:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.410808:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.410824:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947667.410885:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947667.410890:0:18616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947667.410919:0:18616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.410950:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555017c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.410974:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 7 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947667.410983:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:0.0:1783947667.410986:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947667.410991:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96400, rc 0) 00000100:00100000:0.0:1783947667.411077:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+7:15070:x1870604214068480:12345-192.168.204.3@tcp:101:mkdir.0 Request processed in 531us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947667.411086:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00010000:00010000:1.0:1783947668.212571:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947668.723681:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236168960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947668.723779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947668.723863:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236169088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783947668.723868:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947668.723880:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236168832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947668.723935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947668.723975:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783947668.724141:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168960 00000100:00100000:3.0:1783947668.724151:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168960 00000100:00100000:1.0:1783947668.724372:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236169216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783947668.724397:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947668.724426:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169088 00000100:00100000:1.0:1783947668.724428:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169088 00000100:00100000:1.0:1783947668.724482:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169216 00000100:00100000:1.0:1783947668.724485:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169216 00000100:00100000:1.0:1783947668.724520:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947668.724531:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236169088:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947668.724540:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783947668.724562:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236168960:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1783947668.724584:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000004:00000024:3.0:1783947668.724607:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947668.725193:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236168960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 639us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947668.725203:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783947668.725536:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236169088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1002us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947668.725548:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783947668.725587:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947668.725601:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236169216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947668.725622:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947668.725656:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236169088:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783947668.726619:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947668.727225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947668.727303:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236168960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947668.727337:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236168832 00000100:00100000:1.0:1783947668.728008:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236169216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2408us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947668.728021:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783947668.728115:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236169216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947668.728159:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236168832 00000100:00100000:2.0:1783947668.728231:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783947668.728242:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236168832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783947668.728282:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783947668.728415:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236168832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947668.728423:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783947668.728516:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236168832:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783947669.236496:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783947669.754935:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00100000:3.0:1783947669.754951:0:17820:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000001:00100000:2.0:1783947669.755433:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00100000:2.0:1783947669.755442:0:18589:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00000001:00100000:0.0:1783947669.758078:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00000001:00100000:0.0:1783947669.758091:0:17067:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc51fa7f-2744-43d7-9883-dba4b4b8d1ba 00010000:00010000:1.0:1783947670.260249:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783947670.648491:0:19979:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1783947670.771848:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236169472:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.771924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947670.774601:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236169344:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.777132:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236169984:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.777200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777246:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236170496:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.777273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777308:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236171008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947670.777335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777375:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236169600:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.777404:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777428:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236170112:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.777449:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777498:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236170624:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.777522:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777540:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236171136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947670.777574:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777597:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783947670.777604:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236169728:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.777625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.777643:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236170240:0@lo:400:kworker.0 00000100:00100000:1.0:1783947670.777773:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169472 00000100:00100000:1.0:1783947670.777783:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169472 00000100:00100000:1.0:1783947670.777825:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169984 00000100:00100000:1.0:1783947670.777828:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169984 00000100:00100000:1.0:1783947670.777843:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947670.777850:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236169472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947670.777920:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236169472:12345-0@lo:400:kworker.0 Request processed in 70us (5996us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947670.777927:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783947670.777951:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783947670.777956:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236169984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947670.777982:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236169984:12345-0@lo:400:kworker.0 Request processed in 26us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947670.777987:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783947670.778103:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.778130:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236170752:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.778151:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947670.778189:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236170496 00000100:00100000:3.0:1783947670.778193:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236170496 00000100:00100000:3.0:1783947670.778270:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236170624 00000100:00100000:3.0:1783947670.778273:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236170624 00000100:00100000:3.0:1783947670.778284:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236170752 00000100:00100000:3.0:1783947670.778286:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236170752 00000100:00100000:3.0:1783947670.778299:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947670.778304:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236170496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.778333:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1870604236170496:12345-0@lo:400:kworker.0 Request processed in 29us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947670.778338:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783947670.778350:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947670.778355:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236170624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.778381:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1870604236170624:12345-0@lo:400:kworker.0 Request processed in 26us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947670.778385:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783947670.778394:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947670.778399:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236170752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.778432:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236170752:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947670.778437:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783947670.778484:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236171008 00000100:00100000:3.0:1783947670.778488:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236171008 00000100:00100000:3.0:1783947670.778505:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236171136 00000100:00100000:3.0:1783947670.778507:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236171136 00000100:00100000:3.0:1783947670.778517:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947670.778522:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236171008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783947670.778542:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783947670.778570:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236171008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947670.778576:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783947670.778585:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947670.778590:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236171136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947670.778597:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783947670.778614:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236171136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 24us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947670.778618:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783947670.778636:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169600 00000100:00100000:3.0:1783947670.778639:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169600 00000100:00100000:1.0:1783947670.778753:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236170112 00000100:00100000:1.0:1783947670.778757:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236170112 00000100:00100000:3.0:1783947670.778792:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169728 00000100:00100000:3.0:1783947670.778795:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169728 00000100:00100000:2.0:1783947670.780987:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236170240 00000100:00100000:2.0:1783947670.780997:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236170240 00000100:00100000:1.0:1783947670.782691:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947670.782710:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236169600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947670.782804:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236169600:12345-0@lo:400:kworker.0 Request processed in 102us (5398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947670.782811:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783947670.782830:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783947670.782836:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236170112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947670.782863:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236170112:12345-0@lo:400:kworker.0 Request processed in 28us (5413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947670.782876:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947670.786985:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947670.787003:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236169728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.787094:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236169728:12345-0@lo:400:kworker.0 Request processed in 99us (9467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947670.787115:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947670.787139:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947670.787147:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236170240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.787186:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236170240:12345-0@lo:400:kworker.0 Request processed in 39us (9082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947670.787192:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783947670.787237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947670.787270:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169344 00000100:00100000:2.0:1783947670.787277:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169344 00000100:00100000:2.0:1783947670.788007:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783947670.788015:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236169344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788065:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236169344:12345-0@lo:400:kworker.0 Request processed in 51us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947670.788072:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783947670.788177:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236169344:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788192:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236169856:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947670.788260:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236169856 00000100:00100000:2.0:1783947670.788264:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236169856 00000100:00100000:2.0:1783947670.788309:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783947670.788316:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236169856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788348:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236169856:12345-0@lo:400:kworker.0 Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00080000:3.0:1783947670.788354:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783947670.788355:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1783947670.788362:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947670.788367:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947670.788370:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783947670.788393:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236169856:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788411:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236170368:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947670.788490:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236170368 00000100:00100000:2.0:1783947670.788494:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236170368 00000100:00100000:2.0:1783947670.788519:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783947670.788525:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236170368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788554:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1870604236170368:12345-0@lo:400:kworker.0 Request processed in 29us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947670.788560:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783947670.788584:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1870604236170368:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788591:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236170880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947670.788636:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236170880 00000100:00100000:2.0:1783947670.788640:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236170880 00000100:00100000:2.0:1783947670.788672:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783947670.788688:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.788717:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1870604236170880:12345-0@lo:400:kworker.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947670.788723:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1783947670.788746:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d68000 x1870604236170880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947670.788759:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1870604236170880:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.790084:0:3637:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1783947670.790104:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236169728:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.794804:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236171008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783947670.794859:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236169472:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.794873:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236169984:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.794899:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236170240:0@lo:400:kworker.0 00000100:00100000:3.0:1783947670.795778:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1870604236170496:0@lo:400:kworker.0 00000100:00080000:3.0:1783947670.795826:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783947670.796001:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236170752:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.796015:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236169600:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.796026:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236170112:0@lo:400:kworker.0 00010000:00080000:2.0:1783947670.796039:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7bf7d68380 x1870604236170624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783947670.796050:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1870604236170624:0@lo:400:kworker.0 00000100:00100000:2.0:1783947670.796079:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236171136:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783947671.284409:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783947671.734313:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783947672.308612:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947672.579768:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.579820:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.579840:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.579862:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.579880:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.579896:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.579937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.579973:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.580036:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947672.580077:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068608 00000100:00100000:2.0:1783947672.580090:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068608 00000100:00100000:2.0:1783947672.580224:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:2.0:1783947672.580236:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2406:x1870604214068608:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947672.580332:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2406:x1870604214068608:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 98us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.580353:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 145 00000100:00100000:2.0:1783947672.580398:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068736 00000100:00100000:2.0:1783947672.580403:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068736 00000100:00100000:2.0:1783947672.580485:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068864 00000100:00100000:2.0:1783947672.580489:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068864 00000100:00100000:2.0:1783947672.580507:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214069376 00000100:00100000:2.0:1783947672.580511:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214069376 00000100:00100000:2.0:1783947672.580524:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214069248 00000100:00100000:2.0:1783947672.580526:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214069248 00000100:00100000:2.0:1783947672.580544:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:2.0:1783947672.580549:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2407:x1870604214068736:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947672.580585:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2407:x1870604214068736:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 35us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.580592:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:2.0:1783947672.580606:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:2.0:1783947672.580613:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2406:x1870604214068864:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947672.580639:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2406:x1870604214068864:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 27us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.580646:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:2.0:1783947672.580657:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:2.0:1783947672.580663:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2406:x1870604214069376:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947672.580688:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2406:x1870604214069376:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 25us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.580694:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:2.0:1783947672.580705:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:2.0:1783947672.580720:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2407:x1870604214069248:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947672.580749:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2407:x1870604214069248:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 31us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.580756:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:2.0:1783947672.580780:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214069120 00000100:00100000:2.0:1783947672.580784:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214069120 00000100:00100000:2.0:1783947672.580806:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214069632 00000100:00100000:2.0:1783947672.580809:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214069632 00000100:00100000:2.0:1783947672.580820:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214068992 00000100:00100000:2.0:1783947672.580822:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214068992 00000100:00100000:2.0:1783947672.580834:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214069504 00000100:00100000:2.0:1783947672.580836:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214069504 00000100:00100000:2.0:1783947672.580847:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:2.0:1783947672.580852:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2406:x1870604214069120:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947672.580897:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2406:x1870604214069120:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 44us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947672.581049:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:1.0:1783947672.589916:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1783947672.589952:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2406:x1870604214069632:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947672.590068:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2406:x1870604214069632:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 135us (10169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.590079:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1783947672.590121:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:1.0:1783947672.590131:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2407:x1870604214068992:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947672.590164:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2407:x1870604214068992:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 35us (10226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.590171:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:1.0:1783947672.590185:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:1.0:1783947672.590193:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2407:x1870604214069504:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947672.590216:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2407:x1870604214069504:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 24us (10180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947672.590222:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00080000:2.0:1783947672.601625:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783947672.601642:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947672.601646:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947672.601651:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1783947672.827058:0:19409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e 00010000:00010000:3.0:1783947673.331736:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947673.847434:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783947673.847487:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236171264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783947673.847607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947673.847672:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236171392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947673.847705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947673.847745:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236171392 00000100:00100000:2.0:1783947673.847770:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236171392 00000100:00100000:2.0:1783947673.847855:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947673.847865:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236171392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783947673.847932:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783947673.847986:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236171392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947673.847994:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783947673.848053:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236171392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783947673.848523:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947673.848533:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236171520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783947673.848568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947673.849082:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236171264 00000100:00100000:3.0:1783947673.849090:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236171264 00000100:00100000:3.0:1783947673.849149:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783947673.849160:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236171264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947673.849195:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947673.849253:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236171264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947673.849260:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1783947673.849285:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947673.849328:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236171264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947673.849430:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947673.849439:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236171648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783947673.849493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947673.849517:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236171648 00000100:00100000:3.0:1783947673.849521:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236171648 00000100:00100000:3.0:1783947673.849560:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947673.849568:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236171648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947673.849579:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947673.849609:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236171648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947673.849633:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783947673.849651:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947673.849671:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236171648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947673.856296:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236171520 00000100:00100000:0.0:1783947673.856317:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236171520 00000100:00100000:0.0:1783947673.856542:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783947673.856558:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236171520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783947673.856619:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783947673.856775:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236171520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 221us (8205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947673.856784:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783947673.856944:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236171520:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783947674.356201:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783947674.600848:0:20126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd83edba70 20000000:00000080:1.0:1783947674.600870:0:20126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e7bf7aa7c00 uarg=0000000000000000 20000000:01000000:1.0:1783947674.600912:0:20126:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783947674.600919:0:20126:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783947674.600924:0:20126:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783947674.601742:0:20127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1783947674.601878:0:20126:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783947674.611024:0:20126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783947674.611056:0:20126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611075:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611083:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611089:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611095:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611232:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611240:0:20126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 12 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611247:0:20126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611289:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 12 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611302:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 12 pid: 17080 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.611317:0:20126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236171776:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947674.611509:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611518:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 12 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.611527:0:20126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236171904:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947674.611559:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611566:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 23 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.611586:0:20126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172032:0@lo:104: 00000100:00100000:0.0:1783947674.611630:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947674.611666:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611673:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 23 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.611680:0:20126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172160:0@lo:104: 00000100:00100000:0.0:1783947674.611697:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947674.611713:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611721:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 23 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.611728:0:20126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172288:0@lo:104: 00000100:00100000:0.0:1783947674.611742:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783947674.611758:0:20126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.611765:0:20126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 23 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.611772:0:20126:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172416:0@lo:104: 00000100:00100000:0.0:1783947674.611790:0:20126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947674.611800:0:20126:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc2a1d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783947674.611905:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172032 00000100:00100000:2.0:1783947674.611913:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172032 00000100:00100000:2.0:1783947674.611950:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172160 00000100:00100000:2.0:1783947674.611953:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172160 00000100:00100000:2.0:1783947674.611963:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172288 00000100:00100000:2.0:1783947674.611965:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172288 00000100:00100000:2.0:1783947674.611973:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172416 00000100:00100000:2.0:1783947674.611975:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172416 00000100:00100000:2.0:1783947674.611986:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947674.611994:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+6:20126:x1870604236172032:12345-0@lo:104: 00010000:00010000:2.0:1783947674.612007:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612061:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783947674.612067:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+6:20126:x1870604236172032:12345-0@lo:104: Request processed in 74us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.612074:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947674.612108:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947674.612115:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+5:20126:x1870604236172160:12345-0@lo:104: 00010000:00010000:2.0:1783947674.612123:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612153:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783947674.612157:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+5:20126:x1870604236172160:12345-0@lo:104: Request processed in 44us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.612162:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947674.612172:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947674.612177:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:20126:x1870604236172288:12345-0@lo:104: 00010000:00010000:2.0:1783947674.612182:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612201:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783947674.612205:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+4:20126:x1870604236172288:12345-0@lo:104: Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.612209:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947674.612218:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947674.612222:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:20126:x1870604236172416:12345-0@lo:104: 00010000:00010000:2.0:1783947674.612229:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612262:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783947674.612267:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+3:20126:x1870604236172416:12345-0@lo:104: Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.612273:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1783947674.612297:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783947674.612303:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612310:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7e51000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947674.612314:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612322:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947674.612328:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947674.612334:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947674.612362:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612368:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947674.612401:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612409:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac7e51000/0xe6fd1fdb5550160e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501615 expref: -99 pid: 19408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612424:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783947674.612427:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612433:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846aa00 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947674.612436:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612449:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947674.612470:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947674.612476:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947674.612489:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612495:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947674.612510:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612516:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846aa00/0xe6fd1fdb555014b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb555014b7 expref: -99 pid: 18588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612524:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783947674.612527:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612532:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b200 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947674.612534:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612540:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947674.612546:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947674.612556:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947674.612568:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612573:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947674.612580:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612585:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b200/0xe6fd1fdb55501471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb55501478 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612592:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783947674.612594:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612599:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b000 already unused, calling callback (ffffffffc11fcc20) 10000000:00010000:2.0:1783947674.612602:0:17075:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612608:0:17075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783947674.612614:0:17075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783947674.612618:0:17075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783947674.612627:0:17075:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612632:0:17075:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783947674.612642:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612647:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.103@tcp lock: ffff9e7ac846b000/0xe6fd1fdb55501463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe6fd1fdb5550146a expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.612660:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947674.612661:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947674.612663:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783947674.612670:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947674.612688:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236172544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947674.612718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947674.612742:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947674.612747:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236172928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947674.612767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947674.612791:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236172672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947674.612810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947674.612825:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783947674.612830:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236172800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947674.612848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947674.612874:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172544 00000100:00100000:2.0:1783947674.612878:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172544 00010000:00010000:2.0:1783947674.612896:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 24 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947674.612912:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172928 00000100:00100000:2.0:1783947674.612914:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172928 00010000:00010000:2.0:1783947674.612924:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 25 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947674.612944:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172672 00000100:00100000:2.0:1783947674.612947:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172672 00010000:00010000:2.0:1783947674.612956:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 26 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947674.612966:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236172800 00000100:00100000:2.0:1783947674.612968:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236172800 00010000:00010000:2.0:1783947674.612977:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 27 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947674.612988:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947674.612994:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+27:3638:x1870604236172544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947674.613005:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947674.613010:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 27 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613019:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 27 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613036:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947674.613065:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+27:3638:x1870604236172544:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.613071:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783947674.613085:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947674.613090:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+26:3638:x1870604236172928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947674.613098:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947674.613102:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 26 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613119:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 26 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613128:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947674.613149:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+26:3638:x1870604236172928:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.613155:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783947674.613166:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947674.613171:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+25:3639:x1870604236172672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947674.613178:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947674.613182:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 25 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613188:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 25 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613196:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947674.613215:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+25:3639:x1870604236172672:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.613220:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783947674.613230:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947674.613236:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236172800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783947674.613242:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947674.613246:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 24 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613254:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 24 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947674.613269:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947674.613288:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3639:x1870604236172800:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947674.613294:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783947674.613329:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236172800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947674.613336:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236172672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947674.613358:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236172928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783947674.613364:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3638:1870604236172544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783947674.613563:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7e50800/0xe6fd1fdb55501615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb5550160e expref: 23 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.613583:0:20126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172032:0@lo:104: 00010000:00010000:0.0:1783947674.613595:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac7d55800/0xe6fd1fdb555014b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb555014b0 expref: 22 pid: 17082 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.613602:0:20126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172160:0@lo:104: 00010000:00010000:0.0:1783947674.613610:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846a000/0xe6fd1fdb55501478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501471 expref: 21 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.613618:0:20126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172288:0@lo:104: 00010000:00010000:0.0:1783947674.613626:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7ac846ae00/0xe6fd1fdb5550146a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe6fd1fdb55501463 expref: 20 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947674.613633:0:20126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236172416:0@lo:104: 00000100:00100000:2.0:1783947674.632193:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947674.632248:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947674.632296:0:20126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236171776:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947674.632315:0:20126:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20126:1870604236171904:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947674.632352:0:20126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947674.632447:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214069760 00000100:00100000:3.0:1783947674.632483:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214069760 00010000:00010000:3.0:1783947674.632521:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 13 pid: 17080 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947674.632557:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214069888 00000100:00100000:3.0:1783947674.632560:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214069888 00010000:00010000:3.0:1783947674.632573:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 14 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947674.632590:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1783947674.632598:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bff94a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+14:2407:x1870604214069760:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947674.632611:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947674.632618:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 14 pid: 17080 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632629:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 14 pid: 17080 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632649:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97800/0xe6fd1fdb555017a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4308 expref: 14 pid: 17080 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632668:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947674.632733:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bff94a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2407:x1870604214069760:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 135us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947674.632741:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:3.0:1783947674.632795:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:3.0:1783947674.632802:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:2407:x1870604214069888:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947674.632809:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947674.632814:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 12 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632823:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 12 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632833:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bffa5f200/0xe6fd1fdb55501765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4298 expref: 12 pid: 17081 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632844:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632851:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632866:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632874:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632880:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632888:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632901:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97a00 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947674.632905:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632913:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632924:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947674.632934:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947674.632964:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:2407:x1870604214069888:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 162us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947674.632971:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00010000:00010000:0.0:1783947674.633046:0:20126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.633054:0:20126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947674.633061:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e7bdda97a00/0xe6fd1fdb555017d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783947674.742104:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783947675.386623:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947675.891815:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236173056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783947675.892007:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.893797:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236173184:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.893858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.893892:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236173696:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.893920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.893936:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236174208:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.893955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.893976:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783947675.893981:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236173312:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.894007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.894023:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236173824:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.894043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.894055:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236174336:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.894087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.894119:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173696 00000100:00100000:3.0:1783947675.894126:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173696 00000100:00100000:3.0:1783947675.894589:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174208 00000100:00100000:3.0:1783947675.894594:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174208 00000100:00100000:3.0:1783947675.894616:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174336 00000100:00100000:3.0:1783947675.894618:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174336 00000100:00100000:3.0:1783947675.894635:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947675.894644:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236173696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.894711:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1870604236173696:12345-0@lo:400:kworker.0 Request processed in 67us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.894718:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783947675.894736:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783947675.894742:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236174208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.894769:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1870604236174208:12345-0@lo:400:kworker.0 Request processed in 28us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.894775:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783947675.894788:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947675.894793:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236174336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.894818:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1870604236174336:12345-0@lo:400:kworker.0 Request processed in 25us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.894823:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947675.894912:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173312 00000100:00100000:3.0:1783947675.894916:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173312 00000100:00100000:3.0:1783947675.894942:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173824 00000100:00100000:3.0:1783947675.894945:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173824 00000100:00100000:3.0:1783947675.894958:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947675.894965:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236173312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895008:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236173312:12345-0@lo:400:kworker.0 Request processed in 44us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.895014:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783947675.895026:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947675.895032:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236173824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895056:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1870604236173824:12345-0@lo:400:kworker.0 Request processed in 25us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.895062:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1783947675.895075:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947675.895080:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947675.895106:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236173312:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895118:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1870604236173824:0@lo:400:kworker.0 00010000:00080000:3.0:1783947675.895130:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7f100 x1870604236174336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947675.895141:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1870604236174336:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895152:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1870604236173696:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895161:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1870604236174208:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895201:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236173440:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.895254:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236173952:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.895297:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236174464:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.895341:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783947675.895347:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236173568:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.895403:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236174080:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.895437:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236174592:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.895477:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947675.895613:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173184 00000100:00100000:2.0:1783947675.895619:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173184 00000100:00100000:2.0:1783947675.895655:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783947675.895662:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:3639:x1870604236173184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947675.895705:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:3639:x1870604236173184:12345-0@lo:400:kworker.0 Request processed in 44us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947675.895711:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783947675.895880:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947675.895985:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173440 00000100:00100000:3.0:1783947675.895990:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173440 00000100:00100000:3.0:1783947675.896023:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173952 00000100:00100000:3.0:1783947675.896025:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173952 00000100:00100000:3.0:1783947675.896038:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173568 00000100:00100000:3.0:1783947675.896040:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173568 00000100:00100000:3.0:1783947675.896052:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947675.896058:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236173440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.896095:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236173440:12345-0@lo:400:kworker.0 Request processed in 37us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.896100:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783947675.896111:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947675.896116:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236173952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.896140:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236173952:12345-0@lo:400:kworker.0 Request processed in 24us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.896144:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783947675.896153:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947675.896158:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf370a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236173568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.896182:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf370a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1870604236173568:12345-0@lo:400:kworker.0 Request processed in 25us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.896198:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783947675.896312:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174464 00000100:00100000:3.0:1783947675.896316:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174464 00000100:00100000:3.0:1783947675.896336:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174080 00000100:00100000:3.0:1783947675.896338:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174080 00000100:00100000:3.0:1783947675.896346:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174592 00000100:00100000:3.0:1783947675.896349:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174592 00000100:00100000:3.0:1783947675.896374:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947675.896380:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236174464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.896410:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1870604236174464:12345-0@lo:400:kworker.0 Request processed in 31us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.896415:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783947675.896425:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783947675.896430:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236174080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.896475:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1870604236174080:12345-0@lo:400:kworker.0 Request processed in 24us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.896744:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783947675.896762:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783947675.896769:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236174592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.896801:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1870604236174592:12345-0@lo:400:kworker.0 Request processed in 34us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.896806:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783947675.896956:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236173056 00000100:00100000:0.0:1783947675.896962:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236173056 00000100:00100000:0.0:1783947675.897050:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783947675.897058:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236173056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783947675.897083:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783947675.897125:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236173056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (5118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947675.897132:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783947675.897165:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236173056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783947675.897245:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3639:1870604236173184:0@lo:400:kworker.0 00000100:00080000:3.0:1783947675.897272:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783947675.897277:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783947675.897279:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947675.897290:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947675.897316:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236173568:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.897328:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1870604236174080:0@lo:400:kworker.0 00010000:00080000:3.0:1783947675.897339:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7c01c7d500 x1870604236174592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947675.897350:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1870604236174592:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.897374:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1870604236173440:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.897385:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236173952:0@lo:400:kworker.0 00000100:00100000:3.0:1783947675.897396:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1870604236174464:0@lo:400:kworker.0 00000100:00100000:2.0:1783947675.907374:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236174720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947675.907473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947675.907655:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174720 00000100:00100000:1.0:1783947675.907665:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174720 00000100:00100000:1.0:1783947675.907713:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783947675.907722:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236174720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783947675.907747:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783947675.907797:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236174720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947675.907803:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783947675.920498:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236174720:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1783947675.955996:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783947675.956005:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7ac7c05800 from 13 10000000:01000000:0.0:1783947675.956010:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783947675.956057:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947675.956069:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947675.956079:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947675.956105:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236174848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783947675.956172:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947675.956222:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a1a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947675.956273:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174848 00000100:00100000:2.0:1783947675.956281:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174848 00000100:00100000:2.0:1783947675.956335:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783947675.956344:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+20:17085:x1870604236174848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947675.956370:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947675.956387:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb555017e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555017dc expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947675.956411:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb555017e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555017dc expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947675.956429:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5e400/0xe6fd1fdb555017e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555017dc expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947675.956439:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e400, rc 0) 00000100:00100000:2.0:1783947675.956674:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236174848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 330us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947675.956681:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783947675.956757:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236174848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947675.956771:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947675.956791:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947675.956862:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236174976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947675.956887:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947675.956915:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a1a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947675.957013:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236174976 00000100:00100000:2.0:1783947675.957018:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236174976 00000100:00100000:2.0:1783947675.957049:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783947675.957056:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236174976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947675.957155:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236174976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947675.957162:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783947675.957223:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236174976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947675.957250:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947675.957288:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947675.957309:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc8a1a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947675.957346:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236175104 00000100:00100000:2.0:1783947675.957350:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236175104 00000100:00100000:2.0:1783947675.957397:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783947675.957403:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236175104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783947675.957638:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236175104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947675.957645:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783947675.957810:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947675.960397:0:20179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783947675.961949:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783947675.961982:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783947675.961993:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947675.962006:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7bdda97e00/0xe6fd1fdb555017dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017e3 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783947675.962017:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783947675.962020:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bc7e0a000 from 13 10000000:01000000:1.0:1783947675.962022:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783947675.962062:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947675.962071:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947675.962082:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947675.962107:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783947675.962179:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947675.962240:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac65cd840 going to sleep for 11 seconds 00000100:00100000:3.0:1783947675.962409:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236175232 00000100:00100000:3.0:1783947675.962417:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236175232 00000100:00100000:3.0:1783947675.962725:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783947675.962736:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+21:17085:x1870604236175232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947675.962751:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947675.962766:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846be00/0xe6fd1fdb555017f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555017ea expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.962792:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846be00/0xe6fd1fdb555017f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555017ea expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.962803:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846be00/0xe6fd1fdb555017f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555017ea expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.962812:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846be00, rc 0) 00000100:00100000:3.0:1783947675.962872:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:17085:x1870604236175232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.962888:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783947675.962940:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947675.962954:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.962962:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947675.963022:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.963048:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.963071:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bfcba6540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947675.963083:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236175360 00000100:00100000:3.0:1783947675.963087:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236175360 00000100:00100000:3.0:1783947675.963111:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783947675.963117:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:17085:x1870604236175360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.963225:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:17085:x1870604236175360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.963232:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783947675.963261:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.963286:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.963322:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.963334:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd00bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1783947675.963344:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236175488 00000100:00100000:3.0:1783947675.963347:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236175488 00000100:00100000:3.0:1783947675.963383:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783947675.963396:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:17085:x1870604236175488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.966008:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:17085:x1870604236175488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2602us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.966024:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783947675.966453:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783947675.973606:0:20180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783947675.973831:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783947675.973880:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947675.973892:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.973904:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac7d54000/0xe6fd1fdb555017ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017f1 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947675.973915:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947675.973918:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7bff95d000 from 13 10000000:01000000:3.0:1783947675.973920:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947675.973965:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.973972:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.973982:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947675.974008:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.974076:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.974128:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947675.974287:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236175616 00000100:00100000:2.0:1783947675.974295:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236175616 00000100:00100000:2.0:1783947675.974347:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783947675.974368:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be7888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+22:17085:x1870604236175616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783947675.974382:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947675.974396:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bffa5fc00/0xe6fd1fdb555017ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb555017f8 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947675.974419:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bffa5fc00/0xe6fd1fdb555017ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb555017f8 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947675.974430:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bffa5fc00/0xe6fd1fdb555017ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb555017f8 expref: 23 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947675.974440:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5fc00, rc 0) 00000100:00100000:2.0:1783947675.974508:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be7888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236175616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947675.974516:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783947675.975780:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947675.975803:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.975831:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947675.975921:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.975965:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.976006:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e540 going to sleep for 11 seconds 00000100:00100000:2.0:1783947675.976067:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236175744 00000100:00100000:2.0:1783947675.976073:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236175744 00000100:00100000:2.0:1783947675.976114:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783947675.976122:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236175744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783947675.976236:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236175744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947675.976249:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783947675.977994:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.978052:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.978114:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.978148:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e540 going to sleep for 11 seconds 00000100:00100000:3.0:1783947675.978167:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236175872 00000100:00100000:3.0:1783947675.978172:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236175872 00000100:00100000:3.0:1783947675.978220:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783947675.978228:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236175872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.978377:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236175872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947675.978384:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783947675.978432:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236175872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783947675.981071:0:20182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783947675.981374:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783947675.981406:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783947675.981418:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.981430:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846ba00/0xe6fd1fdb555017f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb555017ff expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783947675.981538:0:17085:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783947675.981541:0:17085:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9e7ac7ff8000 from 13 10000000:01000000:3.0:1783947675.981544:0:17085:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783947675.981583:0:17085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.981592:0:17085:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.981603:0:17085:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947675.981630:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236176000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.981702:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.981743:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947675.982748:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236176000 00000100:00100000:0.0:1783947675.982758:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236176000 00000100:00100000:0.0:1783947675.982808:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783947675.982818:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be788b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+23:17085:x1870604236176000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783947675.982835:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947675.983752:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7bdda96e00/0xe6fd1fdb5550180d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe6fd1fdb55501806 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947675.983792:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7bdda96e00/0xe6fd1fdb5550180d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe6fd1fdb55501806 expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947675.983805:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7bdda96e00/0xe6fd1fdb5550180d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe6fd1fdb55501806 expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947675.983827:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96e00, rc 0) 00000100:00100000:0.0:1783947675.985683:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be788b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236176000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2856us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947675.985697:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783947675.986645:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236176000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947675.986675:0:17085:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947675.986690:0:17085:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947675.986778:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236176128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947675.986825:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947675.986878:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e540 going to sleep for 11 seconds 00000100:00100000:0.0:1783947675.987057:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236176128 00000100:00100000:0.0:1783947675.987064:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236176128 00000100:00100000:0.0:1783947675.987102:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783947675.987110:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236176128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947675.988791:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236176128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1672us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947675.988806:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783947675.994748:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236176128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947676.002086:0:17085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236176256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783947676.002179:0:17085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947676.002226:0:17085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc7f9e840 going to sleep for 11 seconds 00000100:00100000:0.0:1783947676.002303:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236176256 00000100:00100000:0.0:1783947676.002311:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236176256 00000100:00100000:0.0:1783947676.002380:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783947676.002391:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236176256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947676.002531:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:17085:x1870604236176256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947676.002539:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783947676.002781:0:17085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01c7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:17085:1870604236176256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783947676.003663:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783947676.003903:0:17085:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783947676.003945:0:17085:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783947676.003956:0:17085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947676.003967:0:17085:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.103@tcp lock: ffff9e7ac846a800/0xe6fd1fdb55501806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe6fd1fdb5550180d expref: -99 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947676.390231:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947676.391371:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070016 00000100:00100000:3.0:1783947676.391383:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070016 00000100:00100000:3.0:1783947676.391640:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:3.0:1783947676.391653:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+11:14919:x1870604214070016:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783947676.391674:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947676.391693:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac846a200/0xe6fd1fdb55501814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4340 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947676.391726:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac846a200/0xe6fd1fdb55501814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4340 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947676.391738:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac846a200/0xe6fd1fdb55501814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4340 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947676.391748:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846a200, rc 0) 00000100:00100000:3.0:1783947676.391818:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:14919:x1870604214070016:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 168us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947676.391825:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 159 00000100:00100000:2.0:1783947676.397562:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947676.397702:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070144 00000100:00100000:3.0:1783947676.397713:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070144 00000100:00100000:3.0:1783947676.397765:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 160 00000100:00100000:3.0:1783947676.397775:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:14919:x1870604214070144:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783947676.398148:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:14919:x1870604214070144:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 372us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947676.398168:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 160 00010000:00010000:2.0:1783947676.404621:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947676.406713:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947676.407576:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070272 00000100:00100000:0.0:1783947676.407588:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070272 00000100:00100000:0.0:1783947676.407661:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:0.0:1783947676.407673:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:14919:x1870604214070272:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783947676.408038:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:14919:x1870604214070272:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 366us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947676.408047:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 161 00000100:00100000:3.0:1783947676.421962:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947676.426034:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070400 00000100:00100000:1.0:1783947676.426052:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070400 00000100:00100000:1.0:1783947676.427774:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:1.0:1783947676.427796:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+12:14919:x1870604214070400:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783947676.427815:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947676.427850:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e7ac7d55400/0xe6fd1fdb5550181b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4347 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947676.427883:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e7ac7d55400/0xe6fd1fdb5550181b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4347 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947676.427896:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e7ac7d55400/0xe6fd1fdb5550181b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4347 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947676.427905:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55400, rc 0) 00000100:00100000:1.0:1783947676.427978:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:14919:x1870604214070400:12345-192.168.204.3@tcp:101:ll_cfg_requeue.0 Request processed in 193us (6025us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947676.427987:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 162 00000100:00100000:0.0:1783947676.432896:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947676.432932:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070528 00000100:00100000:0.0:1783947676.432942:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070528 00000100:00100000:0.0:1783947676.432990:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:0.0:1783947676.433001:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:14919:x1870604214070528:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783947676.433148:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:14919:x1870604214070528:12345-192.168.204.3@tcp:501:ll_cfg_requeue.0 Request processed in 149us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947676.433156:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 163 00000100:00100000:3.0:1783947676.436601:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947676.436670:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070656 00000100:00100000:1.0:1783947676.436680:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070656 00000100:00100000:1.0:1783947676.436726:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 164 00000100:00100000:1.0:1783947676.436735:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:14919:x1870604214070656:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783947676.441673:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:14919:x1870604214070656:12345-192.168.204.3@tcp:503:ll_cfg_requeue.0 Request processed in 4926us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947676.441697:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 164 00010000:00010000:1.0:1783947677.428709:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947677.680524:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947677.680571:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947677.680592:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947677.680628:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947677.680651:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947677.680681:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070912 00000100:00100000:3.0:1783947677.680693:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947677.680694:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070912 00000100:00100000:3.0:1783947677.680721:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071168 00000100:00100000:3.0:1783947677.680726:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071168 00000100:00100000:2.0:1783947677.680769:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071040 00000100:00100000:2.0:1783947677.680774:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071040 00000100:00100000:3.0:1783947677.680784:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071296 00000100:00100000:3.0:1783947677.680789:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071296 00000100:00100000:2.0:1783947677.680794:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071424 00000100:00100000:2.0:1783947677.680799:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071424 00000100:00100000:2.0:1783947677.680825:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:3.0:1783947677.680827:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:2.0:1783947677.680840:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2409:x1870604214070912:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947677.680841:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2409:x1870604214071168:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947677.680918:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2409:x1870604214071168:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947677.680927:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:0.0:1783947677.680947:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:3.0:1783947677.680952:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:3.0:1783947677.680964:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214071296:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947677.680964:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214071040:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947677.681038:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214070784 00000100:00100000:1.0:1783947677.681043:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214070784 00000100:00100000:1.0:1783947677.681076:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:1.0:1783947677.681083:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2408:x1870604214070784:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947677.682087:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2409:x1870604214070912:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1243us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947677.682097:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:2.0:1783947677.682127:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:2.0:1783947677.682138:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2409:x1870604214071424:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947677.682182:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2409:x1870604214071424:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 47us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947677.682189:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00080000:2.0:1783947677.682242:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783947677.682249:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783947677.682252:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783947677.682254:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947677.682332:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214071296:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1359us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947677.682342:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:1.0:1783947677.683067:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2408:x1870604214070784:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1979us (2624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947677.683078:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 165 00000100:00100000:3.0:1783947677.683746:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947677.683848:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947677.683892:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947677.683918:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071680 00000100:00100000:3.0:1783947677.683926:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071680 00000100:00100000:3.0:1783947677.683977:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071808 00000100:00100000:3.0:1783947677.683981:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071808 00000100:00100000:3.0:1783947677.684001:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947677.684010:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214071680:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947677.684197:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214071680:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 187us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947677.684204:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947677.684220:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1783947677.684360:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2408:x1870604214071808:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947677.684392:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2408:x1870604214071808:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 165us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947677.684399:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00080000:3.0:1783947677.684420:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783947677.684424:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947677.685635:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2408:x1870604214071040:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 4666us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947677.685649:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:0.0:1783947677.685679:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071552 00000100:00100000:0.0:1783947677.685687:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071552 00000100:00100000:0.0:1783947677.686372:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:0.0:1783947677.686398:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2408:x1870604214071552:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:0.0:1783947677.686501:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2408:x1870604214071552:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 105us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947677.686508:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00080000:2.0:1783947677.686731:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783947678.451642:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947678.454984:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947678.455166:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214071936 00000100:00100000:2.0:1783947678.455192:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214071936 00000100:00100000:2.0:1783947678.455262:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:2.0:1783947678.455273:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:15586:x1870604214071936:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947678.455295:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947678.455330:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55501822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e434e expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455431:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455447:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455490:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455507:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455514:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455520:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455608:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ea00/0xe6fd1fdb55501837 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455617:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ea00/0xe6fd1fdb55501837 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455624:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ea00/0xe6fd1fdb55501837 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947678.455674:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947678.455678:0:18616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947678.455711:0:18616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ea00/0xe6fd1fdb55501837 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455722:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455728:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455735:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455740:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947678.455745:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455752:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455764:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:2.0:1783947678.455766:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947678.455771:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455777:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e800/0xe6fd1fdb55501829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455790:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455805:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455810:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455815:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5f200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947678.455818:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455825:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455832:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e7ac761ee00) 00010000:00010000:2.0:1783947678.455835:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947678.455837:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455843:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501830 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455875:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ec00/0xe6fd1fdb55501822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e434e expref: 8 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455888:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5ea00/0xe6fd1fdb55501837 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e434e expref: 7 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.455895:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7ac761ec00) 00010000:00010000:2.0:1783947678.455897:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947678.455905:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5ea00, rc 0) 00000100:00100000:2.0:1783947678.455992:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15586:x1870604214071936:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 714us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947678.456001:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947678.462294:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.467615:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214072064 00000100:00100000:1.0:1783947678.467633:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214072064 00000100:00100000:1.0:1783947678.467771:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:1.0:1783947678.467785:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15586:x1870604214072064:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783947678.467901:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15586:x1870604214072064:12345-192.168.204.3@tcp:900:lhsmtool_posix.0 Request processed in 120us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.467911:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:3.0:1783947678.479212:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.479618:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214072320 00000100:00100000:1.0:1783947678.479631:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214072320 00000100:00100000:1.0:1783947678.479849:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:1.0:1783947678.479863:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15586:x1870604214072320:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947678.479893:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947678.479925:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550183e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4355 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480033:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480068:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480085:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480713:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480739:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480752:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480890:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55501853 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480899:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55501853 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.480906:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55501853 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947678.480917:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783947678.481165:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481174:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481182:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481196:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.481200:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481207:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481219:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e7ac761ec00) 00010000:00010000:1.0:1783947678.481222:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.481226:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481232:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb55501845 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481246:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481252:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481257:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481261:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.481263:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481269:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481285:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e7be782fe00) 00010000:00010000:1.0:1783947678.481287:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.481290:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.481295:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb5550184c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.482501:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb5550183e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4355 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.482525:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55c00/0xe6fd1fdb55501853 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4355 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.482533:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7be782f900) 00010000:00010000:1.0:1783947678.482536:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.482538:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d55c00, rc 0) 00000100:00100000:1.0:1783947678.482815:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15586:x1870604214072320:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 2953us (3686us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783947678.482825:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1783947678.486087:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.486350:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214072448 00000100:00100000:0.0:1783947678.486364:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214072448 00000100:00100000:0.0:1783947678.486541:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:0.0:1783947678.486553:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15586:x1870604214072448:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783947678.486723:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15586:x1870604214072448:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 172us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947678.486732:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 25 00000100:00100000:2.0:1783947678.492080:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.492293:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214072576 00000100:00100000:0.0:1783947678.492304:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214072576 00000100:00100000:0.0:1783947678.492374:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:0.0:1783947678.492384:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15586:x1870604214072576:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1783947678.499163:0:17088:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6714us 00000100:00100000:2.0:1783947678.516167:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15586:x1870604214072576:12345-192.168.204.3@tcp:59:lhsmtool_posix.0 Request processed in 23771us (24084us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947678.516181:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:3.0:1783947678.537534:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.537595:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214072704 00000100:00100000:1.0:1783947678.537606:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214072704 00000100:00100000:1.0:1783947678.537783:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:1.0:1783947678.537794:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15592:x1870604214072704:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947678.537817:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947678.537839:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e435c expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.537940:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.537954:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.537966:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.537981:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.537988:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.537996:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538051:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538059:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538066:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538072:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.538076:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538093:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538106:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:1.0:1783947678.538109:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.538114:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538120:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55e00/0xe6fd1fdb55501868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538134:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538140:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538145:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538150:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac7d55800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.538153:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538158:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538165:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e7be782fe00) 00010000:00010000:1.0:1783947678.538168:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.538170:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538186:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d55800/0xe6fd1fdb5550186f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538219:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501861 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e435c expref: 10 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538230:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:1.0:1783947678.538232:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.538236:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac7d54c00/0xe6fd1fdb55501861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e435c expref: 10 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.538245:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac7d54c00, rc 0) 00000100:00100000:1.0:1783947678.538322:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15592:x1870604214072704:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 530us (799us total) trans 0 rc 301/301 00000100:00100000:1.0:1783947678.538330:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1783947678.545617:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.545846:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214072832 00000100:00100000:0.0:1783947678.545858:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214072832 00000100:00100000:0.0:1783947678.545914:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:0.0:1783947678.545925:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15592:x1870604214072832:12345-192.168.204.3@tcp:700:lfs.0 00000100:00100000:0.0:1783947678.546068:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15592:x1870604214072832:12345-192.168.204.3@tcp:700:lfs.0 Request processed in 145us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947678.546075:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:3.0:1783947678.550406:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.550533:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214073088 00000100:00100000:1.0:1783947678.550544:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214073088 00000100:00100000:1.0:1783947678.550597:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:1.0:1783947678.550605:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:15592:x1870604214073088:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:1.0:1783947678.550670:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947678.550695:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ac00/0xe6fd1fdb5550178f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e42c9 expref: 9 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.550714:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:1.0:1783947678.550719:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947678.550776:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.550812:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 5 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.550821:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.550853:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 5 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.550866:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 5 pid: 18616 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947678.550879:0:17089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17089:1870604236176384:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947678.550947:0:17089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bf7d3cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947678.553951:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.554046:0:17089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17089:1870604236176384:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947678.554070:0:17089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947678.554131:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214073216 00000100:00100000:2.0:1783947678.554138:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214073216 00010000:00010000:2.0:1783947678.554172:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 6 pid: 18616 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947678.554209:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:2.0:1783947678.554217:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2406:x1870604214073216:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947678.554231:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947678.554238:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 6 pid: 18616 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.554249:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 6 pid: 18616 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.554269:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555017ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4339 expref: 6 pid: 18616 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.554285:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:2.0:1783947678.554301:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.554320:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.554328:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.554360:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947678.554410:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac85eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2406:x1870604214073216:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 193us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947678.554417:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00010000:00010000:1.0:1783947678.554547:0:17089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.554554:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.554577:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.554587:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.554604:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557033:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557057:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557069:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947678.557089:0:17089:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab0c685f reply state 000000000e11ec80 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557098:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557105:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:1.0:1783947678.557107:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947678.557111:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783947678.557117:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783947678.557125:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557130:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557136:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557141:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.557152:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557160:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557170:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bfcb9f500) 00010000:00010000:1.0:1783947678.557173:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.557176:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557183:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501876 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947678.557200:0:17089:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab0c685f reply state 000000000e11ec80 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557207:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.557214:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e7be782fc00) 00010000:00010000:1.0:1783947678.557216:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947678.557218:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783947678.557364:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac6612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+10:15592:x1870604214073088:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 6755us (6962us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783947678.557373:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1783947678.677108:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.677607:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214073344 00000100:00100000:0.0:1783947678.677618:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214073344 00000100:00100000:0.0:1783947678.677683:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:0.0:1783947678.677693:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+10:15600:x1870604214073344:12345-192.168.204.3@tcp:101:lctl.0 00010000:00010000:0.0:1783947678.677731:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947678.680106:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb5550188b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4363 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.680206:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55501892 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.680222:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55501892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.680235:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55501892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947678.680288:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947678.680293:0:18616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947678.680339:0:18616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55501892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.682781:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb5550188b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4363 expref: 12 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.682821:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97800/0xe6fd1fdb55501892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4363 expref: 11 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.682832:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:0.0:1783947678.682836:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947678.682839:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97800, rc 0) 00000100:00100000:0.0:1783947678.682939:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+11:15600:x1870604214073344:12345-192.168.204.3@tcp:101:lctl.0 Request processed in 5245us (5839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947678.682948:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1783947678.714221:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947678.714339:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214073472 00000100:00100000:3.0:1783947678.714360:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214073472 00000100:00100000:1.0:1783947678.714658:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1783947678.714684:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:15601:x1870604214073472:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947678.714828:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947678.714851:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e436a expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.714932:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb555018a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.714948:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb555018a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.714960:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb555018a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947678.715019:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783947678.716847:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947678.716892:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb555018a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.716932:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e436a expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.716953:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438a00/0xe6fd1fdb555018a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e436a expref: 6 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.716961:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:1.0:1783947678.716964:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947678.716967:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438a00, rc 0) 00000100:00100000:1.0:1783947678.718581:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15601:x1870604214073472:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 3899us (4356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.718594:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1783947678.731361:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.731585:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214073600 00000100:00100000:1.0:1783947678.731599:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214073600 00000100:00100000:1.0:1783947678.731700:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:1.0:1783947678.731712:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:15601:x1870604214073600:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947678.731741:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947678.731767:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb555018a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4371 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.733688:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.733723:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.733741:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.733754:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.733761:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.733768:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735651:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fa00/0xe6fd1fdb555018bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735683:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fa00/0xe6fd1fdb555018bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735817:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fa00/0xe6fd1fdb555018bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947678.735870:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783947678.735874:0:17087:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783947678.735901:0:17087:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fa00/0xe6fd1fdb555018bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735915:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735923:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735945:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735951:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947678.735956:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735963:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735975:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:2.0:1783947678.735978:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947678.735982:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.735988:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438400/0xe6fd1fdb555018ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.736003:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.736008:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.736013:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.736017:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947678.736943:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.736971:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.736983:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e7be782fc00) 00010000:00010000:2.0:1783947678.736985:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783947678.736989:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.736995:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438800/0xe6fd1fdb555018b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.737046:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb555018a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4371 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.737061:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fa00/0xe6fd1fdb555018bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4371 expref: 7 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.737068:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:2.0:1783947678.737071:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783947678.737073:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5fa00, rc 0) 00000100:00100000:2.0:1783947678.737149:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+7:15601:x1870604214073600:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 5439us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947678.737158:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:3.0:1783947678.757309:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947678.757520:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214073728 00000100:00100000:2.0:1783947678.757534:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214073728 00000100:00100000:2.0:1783947678.757612:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:2.0:1783947678.757623:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:15601:x1870604214073728:12345-192.168.204.3@tcp:900:lfs.0 00000100:00100000:2.0:1783947678.757748:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:15601:x1870604214073728:12345-192.168.204.3@tcp:900:lfs.0 Request processed in 127us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947678.757758:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:3.0:1783947678.768746:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947678.770088:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214073984 00000100:00100000:2.0:1783947678.770115:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214073984 00000100:00100000:2.0:1783947678.770210:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:2.0:1783947678.770225:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+7:15601:x1870604214073984:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947678.770255:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947678.770286:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555018c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4378 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947678.770439:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783947678.770655:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555018c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4378 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.770673:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:2.0:1783947678.770677:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947678.770683:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e600/0xe6fd1fdb555018c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4378 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947678.770710:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5e600, rc 0) 00000100:00100000:2.0:1783947678.770802:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+8:15601:x1870604214073984:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 582us (2072us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1783947678.770809:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:3.0:1783947678.782211:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.782358:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214074240 00000100:00100000:0.0:1783947678.782374:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214074240 00000100:00100000:0.0:1783947678.782505:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:0.0:1783947678.782517:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+8:15601:x1870604214074240:12345-192.168.204.3@tcp:36:lfs.0 00010000:00010000:0.0:1783947678.782574:0:18616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947678.782601:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fa00/0xe6fd1fdb555018bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4371 expref: 8 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.782623:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947678.782629:0:18616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947678.782652:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.782665:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.782675:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783947678.782892:0:18616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000065118381 reply state 000000000c7c2301 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.782905:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.782912:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947678.782914:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1783947678.782917:0:18616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783947678.782924:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783947678.783035:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+9:15601:x1870604214074240:12345-192.168.204.3@tcp:36:lfs.0 Request processed in 520us (839us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783947678.783064:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 33 00000100:00100000:3.0:1783947678.785184:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.785259:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214074496 00000100:00100000:1.0:1783947678.785272:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214074496 00000100:00100000:1.0:1783947678.785353:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:1.0:1783947678.785365:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+9:15601:x1870604214074496:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947678.789041:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+10:15601:x1870604214074496:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 3659us (3852us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783947678.789091:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1783947678.798079:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.798177:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214074752 00000100:00100000:1.0:1783947678.798191:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214074752 00000100:00100000:1.0:1783947678.798277:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:1.0:1783947678.798290:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+10:15601:x1870604214074752:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947678.798334:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947678.798362:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555018d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e437f expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798506:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798526:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798540:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798552:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798559:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798566:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947678.798703:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783947678.798822:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798849:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798856:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798864:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.798869:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798878:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798893:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:1.0:1783947678.798896:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.798902:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798908:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb555018df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798923:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798930:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798936:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798941:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.798950:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798956:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798964:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e7be782fc00) 00010000:00010000:1.0:1783947678.798967:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.798970:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.798977:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb555018e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.799020:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555018d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e437f expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.799032:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:1.0:1783947678.799035:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947678.799038:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb555018d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e437f expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.799048:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439600, rc 0) 00000100:00100000:1.0:1783947678.799124:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+11:15601:x1870604214074752:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 836us (1339us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1783947678.799133:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 34 00000100:00100000:2.0:1783947678.806121:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.807633:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214074880 00000100:00100000:0.0:1783947678.807652:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214074880 00000100:00100000:0.0:1783947678.807746:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:0.0:1783947678.807759:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+11:15601:x1870604214074880:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:0.0:1783947678.807805:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947678.807833:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555018f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4386 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.807967:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.807986:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.808001:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947678.808034:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783947678.808038:0:18616:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947678.808063:0:18616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.808094:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555018f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 13 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.808117:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 12 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.808152:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947678.808155:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783947678.808159:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96c00, rc 0) 00000100:00100000:0.0:1783947678.808249:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+12:15601:x1870604214074880:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 493us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947678.808258:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 35 00000100:00100000:0.0:1783947678.818847:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.818975:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214075008 00000100:00100000:1.0:1783947678.818990:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214075008 00000100:00100000:1.0:1783947678.819071:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:1.0:1783947678.819085:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+12:15601:x1870604214075008:12345-192.168.204.3@tcp:37:lfs.0 00000100:00100000:1.0:1783947678.827889:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+12:15601:x1870604214075008:12345-192.168.204.3@tcp:37:lfs.0 Request processed in 8789us (9039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.827910:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000040:00080000:1.0:1783947678.837247:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783947678.838103:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.838198:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214075264 00000100:00100000:0.0:1783947678.838211:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214075264 00000100:00100000:0.0:1783947678.838314:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1783947678.838326:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7f32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+12:15601:x1870604214075264:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947678.838684:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7f32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+13:15601:x1870604214075264:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 360us (589us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783947678.838692:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 4 00000100:00100000:0.0:1783947678.894136:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.894257:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214075392 00000100:00100000:1.0:1783947678.894271:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214075392 00000100:00100000:1.0:1783947678.894363:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:1.0:1783947678.894375:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+11:15607:x1870604214075392:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947678.894409:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947678.894452:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e438d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894570:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894587:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894599:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894618:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894625:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894631:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894757:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438200/0xe6fd1fdb55501917 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894767:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438200/0xe6fd1fdb55501917 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894775:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438200/0xe6fd1fdb55501917 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947678.894822:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783947678.894827:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947678.894871:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438200/0xe6fd1fdb55501917 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894886:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894894:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894901:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894907:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.894912:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894920:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894933:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:1.0:1783947678.894941:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.894947:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894954:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894971:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894977:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894984:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894989:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.894991:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.894997:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.895003:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e7be782fc00) 00010000:00010000:1.0:1783947678.895005:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.895008:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.895012:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501910 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.895038:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e438d expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.895061:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438200/0xe6fd1fdb55501917 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e438d expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.895069:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:1.0:1783947678.895071:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783947678.895073:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438200, rc 0) 00000100:00100000:1.0:1783947678.895165:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:15607:x1870604214075392:12345-192.168.204.3@tcp:101:bash.0 Request processed in 791us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.895172:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 36 00000100:00100000:3.0:1783947678.898653:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947678.898782:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214075520 00000100:00100000:2.0:1783947678.898830:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214075520 00000100:00100000:2.0:1783947678.898908:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:2.0:1783947678.898920:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15607:x1870604214075520:12345-192.168.204.3@tcp:900:bash.0 00000100:00100000:2.0:1783947678.899036:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:15607:x1870604214075520:12345-192.168.204.3@tcp:900:bash.0 Request processed in 118us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947678.899045:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00000040:00080000:3.0:1783947678.900375:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783947678.903044:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.903409:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214075776 00000100:00100000:0.0:1783947678.903727:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214075776 00000100:00100000:0.0:1783947678.903931:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:0.0:1783947678.903945:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+12:15607:x1870604214075776:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947678.903977:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947678.904008:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb5550191e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4394 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.904168:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.904207:0:18616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 12 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.904217:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.904266:0:18616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 12 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.904282:0:18616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 12 pid: 18616 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947678.904311:0:18616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18616:1870604236176512:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947678.904494:0:18616:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd5670b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783947678.908072:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.908339:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214075904 00000100:00100000:0.0:1783947678.908353:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214075904 00010000:00010000:0.0:1783947678.908412:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 13 pid: 18616 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947678.908500:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 16 00000100:00100000:0.0:1783947678.908511:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+13:2406:x1870604214075904:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947678.908531:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947678.908539:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 13 pid: 18616 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.908553:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 13 pid: 18616 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.908600:0:18240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947678.908606:0:18240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.908617:0:18240:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.908626:0:18240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947678.908651:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947678.908723:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+13:2406:x1870604214075904:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 212us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947678.908732:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 16 00010000:00010000:1.0:1783947678.909345:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555018fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4386 expref: 12 pid: 18616 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947678.909374:0:18616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18616:1870604236176512:192.168.204.3@tcp:104: 00010000:00010000:1.0:1783947678.909404:0:18616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.909415:0:18616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.909433:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.909514:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.909527:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.909552:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910802:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910827:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910841:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947678.910862:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783947678.910918:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910926:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910933:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910940:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947678.910944:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910951:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910964:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:1.0:1783947678.910967:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947678.910985:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.910992:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501925 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947678.911011:0:18616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000078d434dd reply state 000000004d30fc9d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.911025:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.911030:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e7be782f300) 00010000:00010000:1.0:1783947678.911032:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947678.911035:0:18616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783947678.911088:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb5550191e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 15 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.911106:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 14 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.911113:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947678.911116:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783947678.911118:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438c00, rc 0) 00000100:00100000:1.0:1783947678.912008:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+15:15607:x1870604214075776:12345-192.168.204.3@tcp:101:bash.0 Request processed in 8061us (8973us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783947678.912020:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 37 00000100:00100000:3.0:1783947678.929387:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947678.929551:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214076032 00000100:00100000:1.0:1783947678.929565:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214076032 00000100:00100000:1.0:1783947678.929654:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:1.0:1783947678.929666:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+15:15607:x1870604214076032:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947678.929731:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947678.929761:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb55501941 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e439b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.929870:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501948 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.929892:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.929907:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947678.929978:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783947678.929984:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947678.930009:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.930023:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.930052:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb55501941 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e439b expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.930076:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501948 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e439b expref: 16 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947678.930086:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947678.930090:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783947678.930094:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438e00, rc 0) 00000100:00100000:1.0:1783947678.930186:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+16:15607:x1870604214076032:12345-192.168.204.3@tcp:101:bash.0 Request processed in 522us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.930193:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 38 00000100:00100000:3.0:1783947678.933886:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947678.934043:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214076288 00000100:00100000:0.0:1783947678.934058:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214076288 00000100:00100000:0.0:1783947678.934133:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1783947678.934146:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+16:15607:x1870604214076288:12345-192.168.204.3@tcp:35:bash.0 00000100:00100000:0.0:1783947678.934606:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac8621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+17:15607:x1870604214076288:12345-192.168.204.3@tcp:35:bash.0 Request processed in 460us (734us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783947678.934615:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 5 00000100:00100000:0.0:1783947678.963986:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783947678.964021:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236176640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783947678.964132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947678.964498:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236176896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947678.964531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947678.964576:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783947678.964582:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236176768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947678.964610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947678.964682:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236176640 00000100:00100000:1.0:1783947678.964692:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236176640 00000100:00100000:1.0:1783947678.964756:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236176896 00000100:00100000:1.0:1783947678.964759:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236176896 00000100:00100000:1.0:1783947678.964790:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947678.964801:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236176640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783947678.964854:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783947678.964913:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236176640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.964921:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783947678.964943:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783947678.964949:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236176896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947678.964967:0:19080:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783947678.964996:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236176896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.965002:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783947678.965023:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236176768 00000100:00100000:1.0:1783947678.965026:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236176768 00000100:00100000:1.0:1783947678.965060:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783947678.965066:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236176768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783947678.965088:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947678.965119:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236176768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.965126:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783947678.965313:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236176768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783947678.965328:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236176896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783947678.965366:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236176640:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1783947678.965855:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783947678.965958:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783947678.965974:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236177024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947678.966026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947678.966155:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236177024 00000100:00100000:1.0:1783947678.966162:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236177024 00000100:00100000:1.0:1783947678.966224:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783947678.966232:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236177024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783947678.966250:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783947678.966306:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236177024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947678.966313:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783947678.966391:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236177024:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783947678.967629:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783947679.034351:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947679.034612:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214076544 00000100:00100000:2.0:1783947679.034629:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214076544 00000100:00100000:2.0:1783947679.034735:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00100000:2.0:1783947679.034750:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+17:15617:x1870604214076544:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:2.0:1783947679.034798:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947679.034832:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fe00/0xe6fd1fdb5550194f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43a2 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783947679.034971:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783947679.035109:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fe00/0xe6fd1fdb5550194f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43a2 expref: 19 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947679.035126:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:2.0:1783947679.035130:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783947679.035135:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5fe00/0xe6fd1fdb5550194f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43a2 expref: 19 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947679.035153:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5fe00, rc 0) 00000100:00100000:2.0:1783947679.035239:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+18:15617:x1870604214076544:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 494us (905us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783947679.035269:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 39 00000100:00080000:0.0:1783947679.036196:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783947679.044197:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947679.044341:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214076800 00000100:00100000:0.0:1783947679.044354:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214076800 00000100:00100000:1.0:1783947679.044529:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:1.0:1783947679.044546:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+18:15617:x1870604214076800:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947679.045221:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+19:15617:x1870604214076800:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 674us (1035us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783947679.045232:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 6 00000100:00100000:3.0:1783947679.076657:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947679.077106:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214077056 00000100:00100000:1.0:1783947679.077121:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214077056 00000100:00100000:1.0:1783947679.077252:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:1.0:1783947679.077265:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+19:15620:x1870604214077056:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947679.077309:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947679.077954:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb5550195d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43a9 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.079085:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501964 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.079110:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.079125:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501964 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947679.079141:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783947679.079312:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb5550195d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43a9 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.079337:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501964 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43a9 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.079348:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947679.079368:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947679.079373:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97000, rc 0) 00000100:00100000:0.0:1783947679.079691:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:15620:x1870604214077056:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 2425us (3046us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783947679.079701:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 40 00000100:00100000:2.0:1783947679.083496:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947679.083549:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947679.083646:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214077184 00000100:00100000:0.0:1783947679.083660:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214077184 00000100:00100000:0.0:1783947679.083735:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:0.0:1783947679.083746:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:15620:x1870604214077184:12345-192.168.204.3@tcp:54:lfs.0 00010000:00010000:0.0:1783947679.083863:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.083887:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.083903:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.083956:0:17087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.083965:0:17087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.083972:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.083980:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947679.083985:0:17087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.084018:0:17087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.084034:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947679.084037:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783947679.084043:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.084051:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501972 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947679.084172:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:15620:x1870604214077184:12345-192.168.204.3@tcp:54:lfs.0 Request processed in 427us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947679.084182:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 41 00000100:00100000:3.0:1783947679.084380:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214077312 00000100:00100000:3.0:1783947679.084387:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214077312 00000100:00100000:3.0:1783947679.084437:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:3.0:1783947679.084445:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:2407:x1870604214077312:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947679.084496:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947679.084516:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb55501964 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43a9 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947679.084531:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:3.0:1783947679.084534:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947679.084557:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+20:2407:x1870604214077312:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 114us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947679.084573:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 0 00000100:00100000:2.0:1783947679.087400:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947679.088099:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214077568 00000100:00100000:0.0:1783947679.088115:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214077568 00000100:00100000:0.0:1783947679.088234:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 7 00000100:00100000:0.0:1783947679.088247:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+20:15620:x1870604214077568:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:0.0:1783947679.088865:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:15620:x1870604214077568:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 617us (1478us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1783947679.088875:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 7 00010000:00010000:1.0:1783947679.476061:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947679.486181:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947679.486965:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214077824 00000100:00100000:3.0:1783947679.486980:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214077824 00000100:00100000:3.0:1783947679.487071:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:3.0:1783947679.487083:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:15651:x1870604214077824:12345-192.168.204.3@tcp:101:cat.0 00010000:00010000:3.0:1783947679.487117:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947679.487145:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846aa00/0xe6fd1fdb55501979 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43b0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947679.487312:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b000/0xe6fd1fdb55501980 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947679.487330:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b000/0xe6fd1fdb55501980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947679.487344:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b000/0xe6fd1fdb55501980 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947679.487358:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783947679.487848:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846aa00/0xe6fd1fdb55501979 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43b0 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947679.487873:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b000/0xe6fd1fdb55501980 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43b0 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947679.487952:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:3.0:1783947679.487956:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947679.487961:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b000, rc 0) 00000100:00100000:3.0:1783947679.488144:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+23:15651:x1870604214077824:12345-192.168.204.3@tcp:101:cat.0 Request processed in 1062us (1977us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1783947679.488154:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 42 00000100:00100000:2.0:1783947679.503509:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947679.503741:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947679.503907:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214078208 00000100:00100000:0.0:1783947679.503921:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214078208 00000100:00100000:0.0:1783947679.504008:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:0.0:1783947679.504020:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+23:2409:x1870604214078208:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783947679.504042:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947679.504074:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b000/0xe6fd1fdb55501980 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43b0 expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.504116:0:18240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947679.504122:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947679.504199:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+22:2409:x1870604214078208:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 181us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947679.504207:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 1 00000100:00100000:1.0:1783947679.505839:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214078080 00000100:00100000:1.0:1783947679.505859:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214078080 00000100:00100000:1.0:1783947679.505944:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:1.0:1783947679.505956:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+22:15651:x1870604214078080:12345-192.168.204.3@tcp:35:cat.0 00000100:00100000:1.0:1783947679.506411:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+23:15651:x1870604214078080:12345-192.168.204.3@tcp:35:cat.0 Request processed in 456us (2917us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1783947679.506431:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 8 00000100:00100000:2.0:1783947679.628159:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947679.638443:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214078464 00000100:00100000:0.0:1783947679.638510:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214078464 00000100:00100000:0.0:1783947679.640291:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:0.0:1783947679.640328:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+23:15657:x1870604214078464:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:0.0:1783947679.640369:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947679.640401:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb5550198e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43b7 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.640582:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501995 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.640601:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501995 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.640617:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501995 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947679.640631:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783947679.642127:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb5550198e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43b7 expref: 26 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.642167:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501995 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43b7 expref: 25 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.642199:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947679.642203:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947679.642208:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:0.0:1783947679.642344:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:15657:x1870604214078464:12345-192.168.204.3@tcp:101:dd.0 Request processed in 2034us (14200us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1783947679.642357:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 43 00000100:00100000:2.0:1783947679.647599:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947679.647644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947679.648077:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214078720 00000100:00100000:3.0:1783947679.648091:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214078720 00000100:00100000:3.0:1783947679.648178:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:3.0:1783947679.648190:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:2407:x1870604214078720:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947679.648214:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947679.648249:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501995 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43b7 expref: 25 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947679.648277:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:3.0:1783947679.648294:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947679.648378:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+24:2407:x1870604214078720:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 189us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947679.648386:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 2 00000100:00100000:0.0:1783947679.651406:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214078592 00000100:00100000:0.0:1783947679.651430:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214078592 00000100:00100000:0.0:1783947679.651592:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:0.0:1783947679.651612:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+24:15657:x1870604214078592:12345-192.168.204.3@tcp:101:dd.0 00010000:00010000:0.0:1783947679.651648:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947679.651681:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43be expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.651738:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.651763:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.651777:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.651946:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 26 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.651970:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 25 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947679.651987:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947679.651991:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947679.651995:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97000, rc 0) 00000100:00100000:0.0:1783947679.652074:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:15657:x1870604214078592:12345-192.168.204.3@tcp:101:dd.0 Request processed in 473us (4492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947679.652082:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 44 00000100:00100000:2.0:1783947679.660541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947679.661253:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214078976 00000100:00100000:1.0:1783947679.661267:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214078976 00000100:00100000:1.0:1783947679.661357:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 45 00000100:00100000:1.0:1783947679.661367:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:15657:x1870604214078976:12345-192.168.204.3@tcp:36:dd.0 00010000:00010000:1.0:1783947679.661545:0:18616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947679.661587:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501948 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e439b expref: 25 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947679.661610:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947679.661615:0:18616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947679.664888:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947679.664931:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947679.664952:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783947679.666490:0:18616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1783947679.667262:0:18616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d784862 reply state 0000000087f776b8 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947679.667527:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947679.667641:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947679.667644:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783947679.667650:0:18616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783947679.669004:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+27:15657:x1870604214078976:12345-192.168.204.3@tcp:36:dd.0 Request processed in 7622us (8465us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1783947679.669020:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 45 00000020:00080000:1.0:1783947679.669029:0:18616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947679.805066:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947679.805195:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214079232 00000100:00100000:1.0:1783947679.805209:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214079232 00000100:00100000:1.0:1783947679.805307:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:1.0:1783947679.805320:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+27:15657:x1870604214079232:12345-192.168.204.3@tcp:35:dd.0 00000100:00100000:1.0:1783947679.805697:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+28:15657:x1870604214079232:12345-192.168.204.3@tcp:35:dd.0 Request processed in 379us (645us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1783947679.805706:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 9 00000100:00100000:2.0:1783947680.040365:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947680.040594:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214079360 00000100:00100000:0.0:1783947680.040608:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214079360 00000100:00100000:0.0:1783947680.040688:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:0.0:1783947680.040700:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+28:15671:x1870604214079360:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:0.0:1783947680.040733:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947680.040773:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43c5 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.040869:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.040889:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.040904:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.040916:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.040922:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.040951:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041061:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041070:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041077:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947680.041133:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783947680.041138:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947680.041191:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041206:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041216:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041222:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041229:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041235:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947680.041241:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041274:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041297:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947680.041300:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947680.041306:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041312:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041331:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041336:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041341:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041347:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947680.041349:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041355:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041361:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e7be782f300) 00010000:00010000:0.0:1783947680.041364:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947680.041367:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041382:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041417:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43c5 expref: 30 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041446:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43c5 expref: 29 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.041453:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947680.041544:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947680.041548:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda97c00, rc 0) 00000100:00100000:0.0:1783947680.041634:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+29:15671:x1870604214079360:12345-192.168.204.3@tcp:101:stat.0 Request processed in 936us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947680.041643:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 46 00000100:00100000:2.0:1783947680.127990:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947680.128271:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214079616 00000100:00100000:0.0:1783947680.128294:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214079616 00000100:00100000:0.0:1783947680.128379:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 47 00000100:00100000:0.0:1783947680.128391:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+29:15677:x1870604214079616:12345-192.168.204.3@tcp:36:truncate.0 00010000:00010000:0.0:1783947680.128516:0:17087:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947680.128553:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43c5 expref: 29 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.128581:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947680.128586:0:17087:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783947680.128911:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.128953:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.128965:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947680.129045:0:17087:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1783947680.129076:0:17087:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008dd2375d reply state 00000000211d7c7d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.129091:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.129098:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947680.129101:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947680.129104:0:17087:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947680.129327:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+31:15677:x1870604214079616:12345-192.168.204.3@tcp:36:truncate.0 Request processed in 935us (1351us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1783947680.129336:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 47 00000020:00080000:0.0:1783947680.129342:0:17087:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947680.301606:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947680.301952:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214079744 00000100:00100000:0.0:1783947680.301970:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214079744 00000100:00100000:0.0:1783947680.302250:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:0.0:1783947680.302265:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+31:15691:x1870604214079744:12345-192.168.204.3@tcp:101:stat.0 00010000:00010000:0.0:1783947680.302317:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947680.302354:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43cc expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302543:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302589:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302603:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302619:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302627:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302634:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302751:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302971:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.302981:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783947680.303944:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1783947680.303955:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783947680.303992:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.304009:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.305919:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.305929:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.305937:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.305944:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947680.305949:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.305959:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.305982:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947680.305986:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947680.305992:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306000:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb555019e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306611:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306624:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306631:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306662:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947680.306666:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306674:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306688:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e7be782f300) 00010000:00010000:0.0:1783947680.306691:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947680.306694:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.306700:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb555019e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.308497:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb555019db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 33 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.309920:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 32 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.309934:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947680.309938:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947680.309943:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a200, rc 0) 00000100:00100000:0.0:1783947680.311403:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+32:15691:x1870604214079744:12345-192.168.204.3@tcp:101:stat.0 Request processed in 9126us (9796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947680.311420:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 48 00000100:00100000:2.0:1783947680.431086:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947680.437226:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214080000 00000100:00100000:1.0:1783947680.437250:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214080000 00000100:00100000:1.0:1783947680.437591:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:1.0:1783947680.437606:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+32:15701:x1870604214080000:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:1.0:1783947680.437649:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947680.437680:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555019f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43d3 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947680.437864:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783947680.438011:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555019f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43d3 expref: 34 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.438052:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:1.0:1783947680.438056:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947680.438063:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb555019f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43d3 expref: 34 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.438080:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438e00, rc 0) 00000100:00100000:1.0:1783947680.438192:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+33:15701:x1870604214080000:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 589us (7122us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1783947680.438202:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 49 00000100:00100000:2.0:1783947680.441944:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947680.442035:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214080256 00000100:00100000:1.0:1783947680.442048:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214080256 00000100:00100000:1.0:1783947680.442124:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 10 00000100:00100000:1.0:1783947680.442145:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7f33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+33:15701:x1870604214080256:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947680.442704:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7f33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+34:15701:x1870604214080256:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 559us (889us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1783947680.442714:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 10 00010000:00010000:2.0:1783947680.500158:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947680.518982:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947680.519094:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214080512 00000100:00100000:3.0:1783947680.519108:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214080512 00000100:00100000:3.0:1783947680.519188:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:3.0:1783947680.519201:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+34:15707:x1870604214080512:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947680.519236:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947680.519277:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846aa00/0xe6fd1fdb55501a05 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43da expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.520005:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.520027:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 35 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.520059:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.520069:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.520118:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.520134:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 35 pid: 17089 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947680.520154:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9429c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236177152:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947680.520832:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 35 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.520846:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 35 pid: 18616 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947680.520857:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236177280:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947680.520893:0:17088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc5dc49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947680.525912:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947680.526017:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947680.526177:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9429c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236177152:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947680.526195:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236177280:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947680.526229:0:17088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947680.526827:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214080640 00000100:00100000:0.0:1783947680.526847:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214080640 00010000:00010000:0.0:1783947680.527109:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 36 pid: 17089 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947680.527214:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214080768 00000100:00100000:0.0:1783947680.527220:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214080768 00010000:00010000:0.0:1783947680.527237:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 37 pid: 18616 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947680.527290:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1783947680.527304:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+37:2407:x1870604214080640:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947680.527330:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947680.527340:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 37 pid: 17089 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527353:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 37 pid: 17089 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527383:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb555019f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43cc expref: 37 pid: 17089 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527415:0:17072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:3.0:1783947680.527432:0:17072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527444:0:17072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527451:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947680.527569:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+36:2407:x1870604214080640:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 267us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947680.527579:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 17 00000100:00100000:3.0:1783947680.527641:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 18 00000100:00100000:3.0:1783947680.527649:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+35:2409:x1870604214080768:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947680.527657:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947680.527671:0:17072:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 35 pid: 18616 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527681:0:17072:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 35 pid: 18616 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527695:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501933 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4394 expref: 35 pid: 18616 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527706:0:17072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:3.0:1783947680.527710:0:17072:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527720:0:17072:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527730:0:17072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.527772:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947680.527793:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+34:2409:x1870604214080768:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 144us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947680.527802:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 18 00010000:00010000:1.0:1783947680.527807:0:17088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.527819:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947680.527851:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1783947680.528026:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846aa00/0xe6fd1fdb55501a05 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 35 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.528059:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 34 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.528068:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947680.528071:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783947680.528074:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b200, rc 0) 00000100:00100000:1.0:1783947680.528104:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+34:15707:x1870604214080512:12345-192.168.204.3@tcp:101:bash.0 Request processed in 8908us (9138us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1783947680.528113:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 50 00000100:00100000:2.0:1783947680.531740:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947680.531910:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214081024 00000100:00100000:0.0:1783947680.531923:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214081024 00000100:00100000:0.0:1783947680.532037:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 51 00000100:00100000:0.0:1783947680.532050:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+34:15707:x1870604214081024:12345-192.168.204.3@tcp:36:bash.0 00010000:00010000:0.0:1783947680.532386:0:17087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.532424:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.532439:0:17087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783947680.532538:0:17087:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1783947680.532560:0:17087:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbc38e96 reply state 0000000018884c2e transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.532576:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.532583:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947680.532587:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783947680.532609:0:17087:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947680.532731:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+37:15707:x1870604214081024:12345-192.168.204.3@tcp:36:bash.0 Request processed in 682us (1002us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1783947680.532740:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 51 00000020:00080000:0.0:1783947680.532747:0:17087:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783947680.535244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947680.535668:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214081152 00000100:00100000:1.0:1783947680.535684:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214081152 00000100:00100000:0.0:1783947680.535873:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:0.0:1783947680.535888:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+37:15707:x1870604214081152:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:0.0:1783947680.535921:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947680.535951:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb55501a21 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43e1 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.536026:0:17087:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb55501a21 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43e1 expref: 38 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.536046:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb55501a21 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43e1 expref: 38 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.536070:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947680.536074:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947680.536079:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffb9a200, rc 0) 00000100:00100000:0.0:1783947680.536156:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15707:x1870604214081152:12345-192.168.204.3@tcp:101:bash.0 Request processed in 271us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947680.536163:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 52 00000100:00100000:2.0:1783947680.543195:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947680.543316:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214081280 00000100:00100000:1.0:1783947680.543329:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214081280 00000100:00100000:1.0:1783947680.543593:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:1.0:1783947680.543607:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15707:x1870604214081280:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947680.543636:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947680.543664:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a28 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43e8 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.543930:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.543950:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 39 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.543960:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.544011:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 39 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.544028:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 39 pid: 17088 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947680.544045:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236177408:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947680.544157:0:17088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa240 going to sleep for 11 seconds 00000100:00100000:2.0:1783947680.547758:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947680.548081:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214081408 00000100:00100000:0.0:1783947680.548093:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214081408 00010000:00010000:0.0:1783947680.548149:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 40 pid: 17088 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947680.548204:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 19 00000100:00100000:3.0:1783947680.548220:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236177408:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947680.548238:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+40:2407:x1870604214081408:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947680.548255:0:17088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.548263:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783947680.548283:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 40 pid: 17088 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.548299:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 40 pid: 17088 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.548327:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846b200/0xe6fd1fdb55501a0c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43da expref: 40 pid: 17088 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.548345:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947680.548351:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.548363:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.548374:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947680.548411:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783947680.548501:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+39:2407:x1870604214081408:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 267us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947680.548510:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 19 00010000:00010000:3.0:1783947680.549476:0:17088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.549510:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947680.549587:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783947680.549592:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947680.549624:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.549671:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a28 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43e8 expref: 39 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.549692:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43e8 expref: 38 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.549702:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:3.0:1783947680.549705:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783947680.549708:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438600, rc 0) 00000100:00100000:3.0:1783947680.550068:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15707:x1870604214081280:12345-192.168.204.3@tcp:101:bash.0 Request processed in 6462us (6883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947680.550078:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 53 00000100:00100000:2.0:1783947680.553241:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947680.553343:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214081664 00000100:00100000:3.0:1783947680.553356:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214081664 00000100:00100000:2.0:1783947680.553714:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:2.0:1783947680.553821:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15707:x1870604214081664:12345-192.168.204.3@tcp:103:bash.0 00010000:00010000:2.0:1783947680.553844:0:17072:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783947680.553879:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9a200/0xe6fd1fdb55501a21 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43e1 expref: 38 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.553904:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43e8 expref: 37 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.553917:0:17072:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:2.0:1783947680.553922:0:17072:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947680.554031:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+36:15707:x1870604214081664:12345-192.168.204.3@tcp:103:bash.0 Request processed in 285us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947680.554039:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 3 00000100:00100000:0.0:1783947680.556133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947680.556676:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214081792 00000100:00100000:1.0:1783947680.556690:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214081792 00000100:00100000:3.0:1783947680.556831:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:3.0:1783947680.556845:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+36:15707:x1870604214081792:12345-192.168.204.3@tcp:58:bash.0 00010000:00010000:3.0:1783947680.557015:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.557038:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947680.557059:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783947680.562584:0:17089:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783947680.563878:0:17089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1783947680.564057:0:17089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1783947680.564175:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+36:15707:x1870604214081792:12345-192.168.204.3@tcp:58:bash.0 Request processed in 7328us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947680.564187:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 54 00000100:00100000:0.0:1783947680.571401:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947680.571522:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214081920 00000100:00100000:2.0:1783947680.571541:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214081920 00000100:00100000:2.0:1783947680.571635:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 55 00000100:00100000:2.0:1783947680.571648:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+36:15707:x1870604214081920:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:2.0:1783947680.571679:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947680.571711:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43ef expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.571787:0:17087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.571800:0:17087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 37 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.571847:0:17087:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.571865:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 37 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.571881:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:2.0:1783947680.571884:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947680.571888:0:17087:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 37 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947680.571898:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5f200, rc 0) 00000100:00100000:2.0:1783947680.571989:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+37:15707:x1870604214081920:12345-192.168.204.3@tcp:101:bash.0 Request processed in 343us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947680.571998:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 55 00000040:00080000:3.0:1783947680.949452:0:17123:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783947680.949500:0:17123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783947680.949536:0:17123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783947680.949547:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783947680.949728:0:17123:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17123:1870604236177536:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783947680.949879:0:17123:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc85dc600 going to sleep for 11 seconds 00000100:00100000:0.0:1783947680.959402:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947680.959520:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214082048 00000100:00100000:1.0:1783947680.959537:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214082048 00000100:00100000:1.0:1783947680.959623:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:1.0:1783947680.959637:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15709:x1870604214082048:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783947680.959692:0:18616:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783947680.959860:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15709:x1870604214082048:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 225us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947680.959869:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 56 00000100:00100000:0.0:1783947680.960360:0:17123:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17123:1870604236177536:192.168.204.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783947680.973522:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947680.978368:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214082176 00000100:00100000:0.0:1783947680.979349:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214082176 00000100:00100000:1.0:1783947680.979684:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:1.0:1783947680.979698:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+37:15709:x1870604214082176:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783947680.979874:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.979897:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.979937:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980101:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980128:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980142:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980177:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980188:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980195:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947680.980445:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783947680.980450:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783947680.980826:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980842:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980850:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980877:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980883:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947680.980887:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980895:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980908:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7be782f900) 00010000:00010000:1.0:1783947680.980911:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947680.980916:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980922:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980938:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980944:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980950:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980954:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947680.980957:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980972:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980979:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9e7be782f500) 00010000:00010000:1.0:1783947680.980982:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947680.980984:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.980989:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.981005:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.981011:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.981016:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.981020:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438e00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947680.981022:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.981028:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.981034:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947680.981036:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947680.981038:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.981054:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947680.981154:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+37:15709:x1870604214082176:12345-192.168.204.3@tcp:34:lhsmtool_posix.0 Request processed in 1455us (7643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947680.981164:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 57 00000100:00100000:2.0:1783947680.986159:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947680.986508:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214082432 00000100:00100000:1.0:1783947680.986521:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214082432 00000100:00100000:1.0:1783947680.986608:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:1.0:1783947680.986621:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+37:15709:x1870604214082432:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947680.986651:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947680.986678:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43f6 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.986837:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.986857:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.986871:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783947680.986885:0:18616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783947680.986993:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987001:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987026:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987033:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947680.987038:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987048:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987063:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947680.987067:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783947680.987072:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987079:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987130:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a59 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43f6 expref: 39 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987142:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e7be782f900) 00010000:00010000:1.0:1783947680.987145:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783947680.987148:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43f6 expref: 39 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947680.987158:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6438600, rc 0) 00000100:00100000:1.0:1783947680.987243:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15709:x1870604214082432:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 624us (1099us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1783947680.990158:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 58 00000100:00100000:0.0:1783947680.991369:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947680.991761:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214082560 00000100:00100000:2.0:1783947680.991775:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214082560 00000100:00100000:2.0:1783947680.991849:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1783947680.991861:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15709:x1870604214082560:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783947680.991912:0:17087:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783947680.992206:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15709:x1870604214082560:12345-192.168.204.3@tcp:53:lhsmtool_posix.0 Request processed in 347us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947680.992215:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 59 00000100:00100000:2.0:1783947681.002177:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947681.003100:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214082816 00000100:00100000:0.0:1783947681.003114:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214082816 00000100:00100000:0.0:1783947681.003276:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:0.0:1783947681.003289:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+38:15709:x1870604214082816:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947681.003319:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947681.003346:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501a6e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e43fd expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783947681.004062:0:17089:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1783947681.004071:0:17089:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1783947681.004098:0:17089:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1783947681.004337:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501a75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.004358:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.004372:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.004708:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501a6e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43fd expref: 41 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.004733:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501a75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43fd expref: 40 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.004801:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7bffb74c00) 00010000:00010000:0.0:1783947681.004805:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783947681.004810:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96c00, rc 0) 00000100:00100000:0.0:1783947681.004913:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7c01d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+40:15709:x1870604214082816:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 1626us (2751us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783947681.004923:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 60 00000100:00100000:3.0:1783947681.008102:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00080000:2.0:1783947681.008180:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783947681.008305:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214083072 00000100:00100000:1.0:1783947681.008319:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214083072 00000100:00100000:1.0:1783947681.008402:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:1.0:1783947681.008414:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+40:15709:x1870604214083072:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947681.008524:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947681.008560:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96c00/0xe6fd1fdb55501a75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43fd expref: 40 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008585:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7bffb74c00) 00010000:00010000:1.0:1783947681.008597:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783947681.008631:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008647:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008659:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008678:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008685:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008692:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008784:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008793:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008800:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008806:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.008811:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008819:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008828:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:1.0:1783947681.008831:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.008835:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008841:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501a83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008850:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008856:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008863:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008874:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.008877:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008884:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008892:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc5c4caee (ffff9e7be782f500) 00010000:00010000:1.0:1783947681.008895:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.008898:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.008905:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438c00/0xe6fd1fdb55501a8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5c4caee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947681.009853:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+39:15709:x1870604214083072:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 1433us (1755us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783947681.009865:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 61 00000100:00100000:3.0:1783947681.012959:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947681.013296:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236177664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.013369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.013426:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236178176:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.013477:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.013500:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236178688:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.013523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.013541:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236179200:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.013569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.013601:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783947681.013607:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236178048:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.013663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.013686:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236178560:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.013720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.013737:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236179072:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.013966:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.013997:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236177920:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.014020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.014036:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236178432:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.014055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.014069:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236178944:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.014088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.014100:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783947681.014105:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236177792:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.014126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.014143:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236178304:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.014164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.014178:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236178816:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.014199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.014224:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236177664 00000100:00100000:0.0:1783947681.014232:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236177664 00000100:00100000:3.0:1783947681.014367:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178048 00000100:00100000:3.0:1783947681.014372:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178048 00000100:00100000:3.0:1783947681.014508:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178560 00000100:00100000:3.0:1783947681.014512:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178560 00000100:00100000:3.0:1783947681.014527:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236177920 00000100:00100000:3.0:1783947681.014530:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236177920 00000100:00100000:3.0:1783947681.014542:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178432 00000100:00100000:3.0:1783947681.014544:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178432 00000100:00100000:3.0:1783947681.014563:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947681.014573:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236178048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947681.014645:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236178048:12345-0@lo:400:kworker.0 Request processed in 73us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.014653:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947681.014672:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947681.014678:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236178560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783947681.014703:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236178560:12345-0@lo:400:kworker.0 Request processed in 26us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.014717:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947681.014727:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783947681.014733:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236177920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783947681.014940:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783947681.014952:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236179328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947681.014998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947681.015038:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236179328 00000100:00100000:2.0:1783947681.015043:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236179328 00000100:00100000:2.0:1783947681.015074:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947681.015081:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236179328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783947681.015108:0:18597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783947681.015143:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236179328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947681.015150:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783947681.015193:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7c01d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236179328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783947681.015225:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214083200 00000100:00100000:2.0:1783947681.015228:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214083200 00000100:00100000:0.0:1783947681.015468:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783947681.015477:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3640:x1870604236177664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.015514:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5bf4e70-0b4f-4c54-b791-4147365ffdfe+24:3640:x1870604236177664:12345-0@lo:400:kworker.0 Request processed in 39us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947681.015520:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783947681.015555:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236177792 00000100:00100000:0.0:1783947681.015560:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236177792 00000100:00100000:0.0:1783947681.015601:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178304 00000100:00100000:0.0:1783947681.015605:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178304 00000100:00100000:0.0:1783947681.015619:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947681.015625:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236177792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.015661:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236177792:12345-0@lo:400:kworker.0 Request processed in 36us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947681.015667:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783947681.015677:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783947681.015683:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236178304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.015707:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236178304:12345-0@lo:400:kworker.0 Request processed in 24us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947681.015713:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783947681.015736:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178176 00000100:00100000:0.0:1783947681.015740:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178176 00000100:00100000:3.0:1783947681.015860:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236177920:12345-0@lo:400:kworker.0 Request processed in 1126us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.015869:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783947681.015943:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236177792:0@lo:400:kworker.0 00000100:00100000:2.0:1783947681.015954:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236178304:0@lo:400:kworker.0 00000100:00100000:2.0:1783947681.015967:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236177920:0@lo:400:kworker.0 00000100:00100000:1.0:1783947681.016081:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178688 00000100:00100000:1.0:1783947681.016086:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178688 00000100:00100000:1.0:1783947681.016110:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236179200 00000100:00100000:1.0:1783947681.016114:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236179200 00000100:00100000:1.0:1783947681.016128:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236179072 00000100:00100000:1.0:1783947681.016130:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236179072 00000100:00100000:1.0:1783947681.016143:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178944 00000100:00100000:1.0:1783947681.016145:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178944 00000100:00100000:1.0:1783947681.016156:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236178816 00000100:00100000:1.0:1783947681.016159:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236178816 00000100:00100000:1.0:1783947681.016172:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783947681.016179:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236178688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947681.016224:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1870604236178688:12345-0@lo:400:kworker.0 Request processed in 45us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.016230:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783947681.016244:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947681.016270:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236179200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947681.016301:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1870604236179200:12345-0@lo:400:kworker.0 Request processed in 33us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.016306:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947681.016318:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947681.016323:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236179072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947681.016350:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1870604236179072:12345-0@lo:400:kworker.0 Request processed in 27us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.016355:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783947681.016368:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947681.016373:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236178944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947681.016413:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1870604236178944:12345-0@lo:400:kworker.0 Request processed in 40us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.016419:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783947681.016430:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947681.016435:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236178816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783947681.016480:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1870604236178816:12345-0@lo:400:kworker.0 Request processed in 44us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.016486:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783947681.016501:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:1.0:1783947681.016508:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+39:15709:x1870604214083200:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783947681.016530:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947681.016560:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a91 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4404 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.016606:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.016623:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.016638:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.016784:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438e00/0xe6fd1fdb55501a91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4404 expref: 41 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.016808:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439e00/0xe6fd1fdb55501a98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4404 expref: 40 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.016818:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:1.0:1783947681.016821:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947681.016825:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439e00, rc 0) 00000100:00100000:1.0:1783947681.016878:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+40:15709:x1870604214083200:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 369us (3933us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.016885:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 62 00000100:00100000:0.0:1783947681.017048:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947681.017056:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236178176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.017097:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1870604236178176:12345-0@lo:400:kworker.0 Request processed in 42us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947681.017103:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783947681.017167:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783947681.017184:0:3637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236179456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783947681.017230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783947681.017285:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783947681.017296:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236178432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.017333:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236178432:12345-0@lo:400:kworker.0 Request processed in 40us (3277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947681.017338:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783947681.017377:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783947681.017382:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783947681.017385:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783947681.017389:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783947681.017423:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236178048:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.017437:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236178560:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.017448:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1870604236179072:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.017485:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5bf4e70-0b4f-4c54-b791-4147365ffdfe:3640:1870604236177664:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.017500:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1870604236178176:0@lo:400:kworker.0 00000100:00100000:0.0:1783947681.017514:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1870604236178688:0@lo:400:kworker.0 00010000:00080000:0.0:1783947681.017531:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5842300 x1870604236179200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783947681.017541:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1870604236179200:0@lo:400:kworker.0 00000100:00100000:3.0:1783947681.018010:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236179456 00000100:00100000:3.0:1783947681.018019:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236179456 00000100:00100000:3.0:1783947681.018057:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947681.018065:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236179456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783947681.018087:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783947681.018192:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1870604236179456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.018200:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783947681.018274:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1870604236178816:0@lo:400:kworker.0 00000100:00100000:3.0:1783947681.018290:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac76b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236178432:0@lo:400:kworker.0 00010000:00080000:3.0:1783947681.018305:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9e7ac5840000 x1870604236178944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783947697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783947681.018317:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5840000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1870604236178944:0@lo:400:kworker.0 00000100:00100000:3.0:1783947681.021970:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947681.022153:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214083456 00000100:00100000:2.0:1783947681.022168:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214083456 00000100:00100000:1.0:1783947681.022609:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:1.0:1783947681.022626:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+40:15709:x1870604214083456:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783947681.022745:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.022875:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.022891:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783947681.023128:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1783947681.023138:0:18616:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 566250680064ns, next at 567250677746ns, rc = 0 00000004:00010000:1.0:1783947681.023203:0:18616:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e74f377c reply state 000000004b0f741e transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.023218:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.023228:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:1.0:1783947681.023231:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783947681.023236:0:18616:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783947681.023489:0:3637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1870604236179456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783947681.023835:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+42:15709:x1870604214083456:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 1212us (1878us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1783947681.023846:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 63 00000100:00100000:3.0:1783947681.026092:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947681.027194:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214083584 00000100:00100000:0.0:1783947681.027211:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214083584 00000100:00100000:0.0:1783947681.027305:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:0.0:1783947681.027318:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+42:15709:x1870604214083584:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783947681.027353:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783947681.027391:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e440b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.027494:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 43 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.027536:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 43 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.027562:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:0.0:1783947681.027565:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783947681.027570:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bdda96400, rc 0) 00000100:00100000:0.0:1783947681.027662:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9429500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+43:15709:x1870604214083584:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 347us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947681.027670:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 64 00000100:00100000:0.0:1783947681.030704:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.030899:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214083712 00000100:00100000:3.0:1783947681.030912:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214083712 00000100:00100000:3.0:1783947681.031003:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:3.0:1783947681.031033:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2409:x1870604214083712:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783947681.031387:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2409:x1870604214083712:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 356us (700us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1783947681.031395:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00080000:0.0:1783947681.032240:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783947681.033735:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:0.0:1783947681.033860:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214083968 00000100:00100000:0.0:1783947681.033872:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214083968 00000100:00100000:0.0:1783947681.033946:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1783947681.033960:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+43:15709:x1870604214083968:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783947681.034288:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+44:15709:x1870604214083968:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 330us (563us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1783947681.034297:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 11 00000100:00100000:0.0:1783947681.036657:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.036751:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214084224 00000100:00100000:3.0:1783947681.036765:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214084224 00000100:00100000:3.0:1783947681.036847:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:3.0:1783947681.036858:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+44:15709:x1870604214084224:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783947681.037003:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+44:15709:x1870604214084224:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.037011:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 65 00000100:00100000:0.0:1783947681.039695:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.039904:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214084352 00000100:00100000:3.0:1783947681.039916:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214084352 00000100:00100000:3.0:1783947681.040016:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:3.0:1783947681.040028:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+44:15709:x1870604214084352:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947681.040057:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947681.040083:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501aad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4412 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.040177:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501ab4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.040196:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.040210:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947681.040305:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783947681.040334:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.040367:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501aad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4412 expref: 46 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.040403:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4412 expref: 45 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.040414:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:3.0:1783947681.040418:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783947681.040433:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:3.0:1783947681.040624:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+45:15709:x1870604214084352:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 598us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.040634:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:0.0:1783947681.044217:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.044451:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214084480 00000100:00100000:3.0:1783947681.044565:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214084480 00000100:00100000:3.0:1783947681.044670:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:3.0:1783947681.044683:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+6:2406:x1870604214084480:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783947681.044708:0:18594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947681.044733:0:18594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4419 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947681.044764:0:18594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a54e19f, blocks: 0x0 00010000:00010000:3.0:1783947681.044807:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1783947681.044831:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947681.044843:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 7 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.044868:0:18594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 7 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.044887:0:18594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b600, rc 0) 00000100:00100000:3.0:1783947681.044964:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:2406:x1870604214084480:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 283us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.044972:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 24 00000100:00100000:2.0:1783947681.048022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947681.048163:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214084736 00000100:00100000:1.0:1783947681.048175:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214084736 00000100:00100000:1.0:1783947681.048359:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:1.0:1783947681.048371:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+45:15709:x1870604214084736:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783947681.048543:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+45:15709:x1870604214084736:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 174us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.048551:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:3.0:1783947681.050712:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947681.051562:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214084864 00000100:00100000:2.0:1783947681.051577:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214084864 00000100:00100000:2.0:1783947681.051651:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:2.0:1783947681.051663:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+45:15709:x1870604214084864:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783947681.058973:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1783947681.058999:0:17067:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1783947681.059086:0:17067:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1783947681.062115:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+20:15709:x1870604214084864:12345-192.168.204.3@tcp:44:lhsmtool_posix.0 Request processed in 10444us (11404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947681.062132:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00010000:00010000:0.0:1783947681.062915:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.062932:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.062964:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.062971:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947681.062977:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.062987:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.063008:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:0.0:1783947681.063011:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783947681.063017:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.063024:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb555018d1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947681.063070:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236179584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783947681.063142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947681.064090:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236179584 00000100:00100000:2.0:1783947681.064105:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236179584 00000100:00100000:2.0:1783947681.064175:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783947681.064186:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1870604236179584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783947681.064407:0:18595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783947681.064411:0:18595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783947681.064414:0:18595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783947681.064416:0:18595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783947679 -> 1783947679 00002000:00010000:2.0:1783947681.064419:0:18595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1783947681.064527:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1870604236179584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 339us (1381us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783947681.064535:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1783947681.064716:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e7be3e9fb80/2, rc 0, transno 8589934596 00000100:00100000:0.0:1783947681.064725:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1870604236179584:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1783947681.065176:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065204:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065212:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065219:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.065224:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065233:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065317:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9e7be782fc00) 00010000:00010000:1.0:1783947681.065321:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.065326:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065333:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439000/0xe6fd1fdb5550187d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065357:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065364:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065370:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065375:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439200 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.065384:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065391:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065399:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:1.0:1783947681.065402:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.065405:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065411:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439200/0xe6fd1fdb55501884 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065424:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065430:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065436:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065441:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.065444:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065450:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065490:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e7be782f300) 00010000:00010000:1.0:1783947681.065493:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.065501:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065508:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb5550192c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065525:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065531:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065537:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065604:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438000 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.065607:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065614:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065623:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947681.065626:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.065628:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065634:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438000/0xe6fd1fdb555019b1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065648:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065664:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065670:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065675:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda96800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.065678:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065684:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065693:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947681.065695:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.065699:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065705:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96800/0xe6fd1fdb555019d4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065720:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065726:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065731:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065735:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffb9b600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.065744:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065750:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065758:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947681.065760:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.065763:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065770:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffb9b600/0xe6fd1fdb55501a1a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17087 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065908:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065917:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065923:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065928:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439400 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.065931:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065938:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065948:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:1.0:1783947681.065950:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783947681.065959:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.065966:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439400/0xe6fd1fdb55501a9f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947681.068333:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.068555:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214084992 00000100:00100000:3.0:1783947681.068567:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214084992 00000100:00100000:3.0:1783947681.068637:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:3.0:1783947681.068648:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:2406:x1870604214084992:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783947681.068895:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:2406:x1870604214084992:12345-192.168.204.3@tcp:16:lhsmtool_posix.0 Request processed in 248us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.068904:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 26 00000100:00100000:2.0:1783947681.072128:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.072225:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214085248 00000100:00100000:3.0:1783947681.072239:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214085248 00000100:00100000:3.0:1783947681.072333:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1783947681.072344:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+14:15709:x1870604214085248:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783947681.072452:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947681.072654:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501ab4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4412 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.072677:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:3.0:1783947681.072683:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783947681.072726:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.072812:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.072825:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783947681.072998:0:17089:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e70b7dd4 reply state 0000000048411511 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.073012:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846a000/0xe6fd1fdb55501ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.073019:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:3.0:1783947681.073021:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783947681.073024:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783947681.073200:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+15:15709:x1870604214085248:12345-192.168.204.3@tcp:36:lhsmtool_posix.0 Request processed in 856us (1085us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1783947681.073209:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1783947681.076570:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947681.076674:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214085376 00000100:00100000:2.0:1783947681.076688:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214085376 00000100:00100000:2.0:1783947681.076844:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1783947681.076857:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15709:x1870604214085376:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783947681.076883:0:18595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783947681.076908:0:18595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4420 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.076950:0:18595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 8 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.076983:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947681.076988:0:18595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783947681.076995:0:18595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 8 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.077041:0:18595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 8 pid: 18594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.077058:0:18595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 8 pid: 18594 timeout: 666 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947681.077074:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3e9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18595:1870604236179712:192.168.204.3@tcp:104: 00000100:00100000:2.0:1783947681.077189:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7f8c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783947681.080877:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.080961:0:18240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214085504 00000100:00100000:3.0:1783947681.080973:0:18240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214085504 00010000:00010000:3.0:1783947681.081049:0:18240:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 9 pid: 18594 timeout: 666 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947681.081104:0:18240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 20 00000100:00100000:3.0:1783947681.081114:0:18240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:2406:x1870604214085504:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783947681.081136:0:18240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783947681.081164:0:18240:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 9 pid: 18594 timeout: 666 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.081180:0:18240:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 9 pid: 18594 timeout: 666 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.081215:0:18240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947681.081221:0:18240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947681.081230:0:18240:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 9 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.081242:0:18240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 9 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.081311:0:18240:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 9 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947681.081328:0:18240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18240:1870604236179840:192.168.204.3@tcp:105: 00000100:00100000:3.0:1783947681.081441:0:18240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc53bb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783947681.083717:0:18240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18240:1870604236179840:192.168.204.3@tcp:105: 00010000:00010000:3.0:1783947681.083758:0:18240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783947681.083827:0:18240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:2406:x1870604214085504:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 2713us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.083843:0:18240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 20 00010000:00010000:2.0:1783947681.084935:0:18595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd955ad5/0xe6fd1fdb55501abb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4419 expref: 8 pid: 18594 timeout: 666 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947681.084960:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3e9c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18595:1870604236179712:192.168.204.3@tcp:104: 00010000:00010000:2.0:1783947681.084996:0:18595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 7 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.085013:0:18595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7bffa5fe00, rc 0) 00000100:00100000:2.0:1783947681.085113:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15709:x1870604214085376:12345-192.168.204.3@tcp:101:lhsmtool_posix.0 Request processed in 8259us (8734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947681.085147:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 27 00000100:00100000:2.0:1783947681.087626:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.087700:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214085632 00000100:00100000:3.0:1783947681.087712:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214085632 00000100:00100000:3.0:1783947681.087794:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:3.0:1783947681.087806:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:2407:x1870604214085632:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783947681.088009:0:18594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783947681.088013:0:18594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783947679 00002000:00010000:3.0:1783947681.088015:0:18594:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783947677 00002000:00010000:3.0:1783947681.088017:0:18594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783947679 -> 1783947679 00002000:00010000:3.0:1783947681.088020:0:18594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1783947681.088311:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+8:2407:x1870604214085632:12345-192.168.204.3@tcp:2:lhsmtool_posix.0 Request processed in 506us (696us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783947681.088321:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 28 00000100:00100000:2.0:1783947681.093675:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.093872:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214085760 00000100:00100000:3.0:1783947681.093887:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214085760 00000100:00100000:3.0:1783947681.093968:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1783947681.093982:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+8:2409:x1870604214085760:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783947681.094085:0:19073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.094112:0:19073:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 8 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.094137:0:19073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947681.094142:0:19073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783947681.094148:0:19073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.094193:0:19073:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 8 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.094210:0:19073:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 8 pid: 18595 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947681.094228:0:19073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19073:1870604236179968:192.168.204.3@tcp:104: 00000100:00100000:3.0:1783947681.094357:0:19073:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc53bb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947681.097634:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947681.097762:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214085888 00000100:00100000:1.0:1783947681.097774:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214085888 00010000:00010000:1.0:1783947681.097821:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 9 pid: 18595 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947681.097876:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 21 00000100:00100000:1.0:1783947681.097888:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:2406:x1870604214085888:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947681.097908:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947681.097937:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 9 pid: 18595 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.097953:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 9 pid: 18595 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.097986:0:17073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947681.097992:0:17073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783947681.097999:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.098012:0:17073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.098063:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947681.098143:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+9:2406:x1870604214085888:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 257us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.098152:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 21 00010000:00010000:3.0:1783947681.099185:0:19073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f7da3ba/0xe6fd1fdb55501ac9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4420 expref: 8 pid: 18595 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947681.099213:0:19073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19073:1870604236179968:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947681.099241:0:19073:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099272:0:19073:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099281:0:19073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099329:0:19073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099340:0:19073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099349:0:19073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099358:0:19073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846b200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947681.099363:0:19073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099373:0:19073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099403:0:19073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.099412:0:19073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501ad0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783947681.100611:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:2409:x1870604214085760:12345-192.168.204.3@tcp:1:lhsmtool_posix.0 Request processed in 6620us (6943us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.100642:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:0.0:1783947681.104371:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947681.104494:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214086144 00000100:00100000:1.0:1783947681.104507:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214086144 00000100:00100000:1.0:1783947681.104587:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 70 00000100:00100000:1.0:1783947681.104600:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+15:15709:x1870604214086144:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783947681.104718:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.104752:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.104764:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.104812:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.104830:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 15 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947681.104848:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236180096:192.168.204.3@tcp:104: 00000100:00100000:1.0:1783947681.104955:0:17088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc63fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783947681.108902:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947681.109157:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214086272 00000100:00100000:2.0:1783947681.109173:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214086272 00010000:00010000:2.0:1783947681.109236:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 16 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947681.109309:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 22 00000100:00100000:2.0:1783947681.109322:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+16:2407:x1870604214086272:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783947681.109342:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783947681.109350:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 16 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.109367:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 16 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.109408:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:2.0:1783947681.109415:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 16 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.109438:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.109448:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.109496:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.109526:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783947681.109609:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+16:2407:x1870604214086272:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 288us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947681.109618:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 22 00010000:00010000:0.0:1783947681.111950:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97000/0xe6fd1fdb555019aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43be expref: 15 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947681.112005:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236180096:192.168.204.3@tcp:104: 00010000:00010000:0.0:1783947681.112036:0:17088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.112048:0:17088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.112055:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.112705:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.112726:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.112736:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.112859:0:17088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.112879:0:17088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 15 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947681.112896:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236180224:192.168.204.3@tcp:104: 00000100:00100000:0.0:1783947681.113076:0:17088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bd01900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947681.117887:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.117997:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac5843480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236180224:192.168.204.3@tcp:104: 00010000:00010000:3.0:1783947681.118030:0:17088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947681.118970:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214086400 00000100:00100000:1.0:1783947681.118984:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214086400 00010000:00010000:1.0:1783947681.119042:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 16 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947681.119096:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 23 00000100:00100000:1.0:1783947681.119108:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+16:2406:x1870604214086400:12345-192.168.204.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783947681.119129:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783947681.119137:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 16 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.119152:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 16 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.119183:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda96400/0xe6fd1fdb55501aa6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.3@tcp remote: 0xef891f92f79e440b expref: 16 pid: 17089 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.119208:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:1.0:1783947681.119214:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.119227:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.119238:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.119638:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783947681.119723:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+15:2406:x1870604214086400:12345-192.168.204.3@tcp:103:ldlm_bl.0 Request processed in 615us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.119762:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 23 00010000:00010000:3.0:1783947681.121223:0:17088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.121306:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783947681.121919:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1783947681.122080:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1783947681.122125:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1783947681.122241:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17088:1870604236180352:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947681.122573:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947681.122677:0:17088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7bc53bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783947681.122729:0:19080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236180352 00000100:00100000:0.0:1783947681.122738:0:19080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236180352 00000100:00100000:0.0:1783947681.122925:0:19080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783947681.122937:0:19080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17088:x1870604236180352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783947681.123061:0:19080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc942b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17088:x1870604236180352:12345-0@lo:1000:mdt00_001.0 Request processed in 126us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783947681.123069:0:19080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783947681.123141:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17088:1870604236180352:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1783947681.123370:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1783947681.123451:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17088:1870604236180480:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783947681.123529:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783947681.123998:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236180480 00000100:00100000:2.0:1783947681.124006:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236180480 00000100:00100000:2.0:1783947681.124043:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947681.124053:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17088:x1870604236180480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783947681.124213:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bc9428e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17088:x1870604236180480:12345-0@lo:1000:mdt00_001.0 Request processed in 161us (682us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1783947681.124221:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783947681.124996:0:17088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7683780 going to sleep for 11 seconds 00000100:00100000:2.0:1783947681.125043:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bc9428700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17088:1870604236180480:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1783947681.125103:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125115:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125124:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125132:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97c00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947681.125137:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125170:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125192:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:2.0:1783947681.125195:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947681.125201:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125207:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97c00/0xe6fd1fdb55501ade lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125332:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125340:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125346:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125351:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac846ae00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:2.0:1783947681.125355:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125362:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125371:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:2.0:1783947681.125373:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783947681.125571:0:17088:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 18 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125601:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 18 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125612:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 18 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.125695:0:17088:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5f200/0xe6fd1fdb55501a3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e43ef expref: 18 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783947681.125713:0:17088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7be3e9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236180608:192.168.204.3@tcp:105: 00000100:00100000:2.0:1783947681.125930:0:17088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9e7ac7f8c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783947681.137728:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947681.137856:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214086528 00000100:00100000:1.0:1783947681.137869:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214086528 00000100:00100000:1.0:1783947681.137953:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:1.0:1783947681.137965:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+19:15707:x1870604214086528:12345-192.168.204.3@tcp:49:bash.0 00000100:00100000:1.0:1783947681.138129:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+19:15707:x1870604214086528:12345-192.168.204.3@tcp:49:bash.0 Request processed in 167us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.138137:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 12 00000100:00100000:0.0:1783947681.138591:0:17088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7be3e9ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17088:1870604236180608:192.168.204.3@tcp:105: 00010000:00010000:0.0:1783947681.138628:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.138641:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846ae00/0xe6fd1fdb55501a36 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141350:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141631:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141649:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141666:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141672:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141680:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141709:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bdda97a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947681.141715:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141724:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141811:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947681.141816:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783947681.141823:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141832:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bdda97a00/0xe6fd1fdb55501ae5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141853:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141860:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141866:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141872:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439a00 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:0.0:1783947681.141875:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141882:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141903:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:0.0:1783947681.141905:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783947681.141909:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783947681.141914:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439a00/0xe6fd1fdb55501ad7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783947681.142204:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac5840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+18:15709:x1870604214086144:12345-192.168.204.3@tcp:57:lhsmtool_posix.0 Request processed in 37599us (37841us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1783947681.142217:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 70 00000020:00080000:0.0:1783947681.142224:0:17088:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783947681.142512:0:17123:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783947681.142518:0:17123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783947681.142562:0:17123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783947681.142569:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783947681.144628:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.147218:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214086656 00000100:00100000:3.0:1783947681.147240:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214086656 00000100:00100000:3.0:1783947681.147596:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1783947681.147612:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+7:15707:x1870604214086656:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:3.0:1783947681.147641:0:18593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947681.147673:0:18593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501aec lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4427 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783947681.147725:0:18593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a54e19f, atime: 0x6a54e19d, ctime: 0x6a54e19f, blocks: 0x0 00010000:00010000:3.0:1783947681.147828:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=566s v=(0 0) 00010000:00010000:3.0:1783947681.147834:0:18593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783947681.147848:0:18593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501aec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4427 expref: 8 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.147870:0:18593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c92f84fc/0xe6fd1fdb55501aec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4427 expref: 8 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.147886:0:18593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846b200, rc 0) 00000100:00100000:3.0:1783947681.148150:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+8:15707:x1870604214086656:12345-192.168.204.3@tcp:101:bash.0 Request processed in 541us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947681.148159:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:1.0:1783947681.148388:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947681.148705:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214086912 00000100:00100000:2.0:1783947681.148715:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214086912 00000100:00100000:2.0:1783947681.148840:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 13 00000100:00100000:2.0:1783947681.148852:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+18:15709:x1870604214086912:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783947681.149221:0:17091:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783947681.149579:0:17091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1783947681.149628:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.149649:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.149663:0:17091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.149688:0:17091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.149695:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.149702:0:17091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783947681.149727:0:17091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783947681.152158:0:17075:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783947681.152180:0:17075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.152196:0:17075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7bffa5e200 already unused, calling callback (ffffffffc0c01360) 00010000:00010000:3.0:1783947681.152200:0:17075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.152212:0:17075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.152237:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e7be782f000) 00010000:00010000:3.0:1783947681.152240:0:17075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783947681.152289:0:17075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.152297:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7bffa5e200/0xe6fd1fdb55501af3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.152318:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947681.152320:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947681.152321:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947681.152562:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947681.153009:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+20:15709:x1870604214086912:12345-192.168.204.3@tcp:35:lhsmtool_posix.0 Request processed in 4155us (4626us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1783947681.153023:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 13 00000020:00080000:2.0:1783947681.153032:0:17091:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783947681.153146:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214087040 00000100:00100000:1.0:1783947681.153157:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214087040 00000100:00100000:1.0:1783947681.153224:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:1.0:1783947681.153235:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+20:15707:x1870604214087040:12345-192.168.204.3@tcp:101:bash.0 00010000:00010000:1.0:1783947681.153334:0:18616:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783947681.153361:0:18616:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501afa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e442e expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.153419:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb55501b01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.153437:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb55501b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.153520:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb55501b01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.153669:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501afa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e442e expref: 22 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.153688:0:18616:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439c00/0xe6fd1fdb55501b01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e442e expref: 21 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.153696:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947681.153699:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783947681.153702:0:18616:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac6439c00, rc 0) 00000100:00100000:1.0:1783947681.156029:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:15707:x1870604214087040:12345-192.168.204.3@tcp:101:bash.0 Request processed in 2778us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.156047:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 71 00000100:00100000:2.0:1783947681.160865:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.160981:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214087296 00000100:00100000:3.0:1783947681.160995:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214087296 00000100:00100000:3.0:1783947681.161111:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 14 00000100:00100000:3.0:1783947681.161124:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+21:15707:x1870604214087296:12345-192.168.204.3@tcp:35:bash.0 00000001:00080000:0.0:1783947681.162824:0:17090:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1783947681.162977:0:17090:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1783947681.163215:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+24:15707:x1870604214087296:12345-192.168.204.3@tcp:35:bash.0 Request processed in 2084us (2356us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1783947681.163231:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 14 00000020:00080000:0.0:1783947681.163238:0:17090:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783947681.269077:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947681.269489:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214087552 00000100:00100000:3.0:1783947681.269502:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214087552 00000100:00100000:3.0:1783947681.269589:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:3.0:1783947681.269602:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+24:15719:x1870604214087552:12345-192.168.204.3@tcp:101:lfs.0 00010000:00010000:3.0:1783947681.269637:0:17087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783947681.269666:0:17087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501b08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef891f92f79e4435 expref: -99 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783947681.269822:0:17087:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783947681.269965:0:17087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501b08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4435 expref: 26 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.269982:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e7bffb74300) 00010000:00010000:3.0:1783947681.269986:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783947681.269992:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac846bc00/0xe6fd1fdb55501b08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.3@tcp remote: 0xef891f92f79e4435 expref: 26 pid: 17087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783947681.270026:0:17087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e7ac846bc00, rc 0) 00000100:00100000:3.0:1783947681.270110:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:15719:x1870604214087552:12345-192.168.204.3@tcp:101:lfs.0 Request processed in 511us (1048us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1783947681.270118:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 72 00000100:00100000:2.0:1783947681.277170:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947681.277299:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214087680 00000100:00100000:1.0:1783947681.277314:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214087680 00000100:00100000:1.0:1783947681.277406:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:1.0:1783947681.277419:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:15719:x1870604214087680:12345-192.168.204.3@tcp:34:lfs.0 00010000:00010000:1.0:1783947681.277591:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277615:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277631:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277686:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277694:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277701:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277810:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277819:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.277826:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783947681.278096:0:18616:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278115:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278123:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278130:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278137:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6438600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.278142:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278160:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278187:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e7be782fe00) 00010000:00010000:1.0:1783947681.278191:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.278198:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278205:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6438600/0xe6fd1fdb55501b16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278223:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278229:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278235:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278240:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439600 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.278243:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278250:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278266:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9e7be782f300) 00010000:00010000:1.0:1783947681.278269:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.278272:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278287:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439600/0xe6fd1fdb55501b1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278304:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278310:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278316:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278321:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e7ac6439800 already unused, calling callback (ffffffffc180d4f0) 00010000:00010000:1.0:1783947681.278325:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278331:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278339:0:18616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e7be782fb00) 00010000:00010000:1.0:1783947681.278341:0:18616:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783947681.278344:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783947681.278350:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e7ac6439800/0xe6fd1fdb55501b24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18616 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783947681.278528:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:15719:x1870604214087680:12345-192.168.204.3@tcp:34:lfs.0 Request processed in 1110us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947681.278538:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 73 00000100:00100000:2.0:1783947681.285010:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947681.288590:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214087936 00000100:00100000:1.0:1783947681.288617:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214087936 00000100:00100000:1.0:1783947681.288783:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 15 00000100:00100000:1.0:1783947681.288801:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+25:15719:x1870604214087936:12345-192.168.204.3@tcp:35:lfs.0 00000100:00100000:1.0:1783947681.289213:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+26:15719:x1870604214087936:12345-192.168.204.3@tcp:35:lfs.0 Request processed in 415us (4330us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1783947681.289222:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 15 00010000:00010000:2.0:1783947681.523988:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783947682.547856:0:17075:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783947682.813245:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947682.813286:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947682.813317:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947682.813338:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947682.813359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:2.0:1783947682.813378:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947682.813387:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088064 00000100:00100000:3.0:1783947682.813397:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088064 00000100:00100000:2.0:1783947682.813404:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947682.813409:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088320 00000100:00100000:1.0:1783947682.813417:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088320 00000100:00100000:2.0:1783947682.813440:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:3.0:1783947682.813470:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 167 00000100:00100000:3.0:1783947682.813482:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2409:x1870604214088064:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947682.813484:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088832 00000100:00100000:2.0:1783947682.813487:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.3@tcp (source: 12345-192.168.204.3@tcp) 00000100:00100000:1.0:1783947682.813490:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088832 00000100:00100000:1.0:1783947682.813514:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088192 00000100:00100000:1.0:1783947682.813518:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088192 00000100:00100000:2.0:1783947682.813524:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088704 00000100:00100000:2.0:1783947682.813529:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088704 00000100:00100000:1.0:1783947682.813543:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:1.0:1783947682.813554:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2409:x1870604214088320:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947682.813558:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a84253a8-4830-4b12-9d0f-3006cd9f4d80+13:2409:x1870604214088064:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 78us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947682.813561:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:3.0:1783947682.813567:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 167 00000100:00100000:2.0:1783947682.813570:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214088832:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947682.813599:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088576 00000100:00100000:1.0:1783947682.813599:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2409:x1870604214088320:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.813604:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088576 00000100:00100000:2.0:1783947682.813607:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214088832:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 36us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.813614:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 66 00000100:00100000:2.0:1783947682.813625:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 67 00000100:00100000:3.0:1783947682.813626:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214089088 00000100:00100000:3.0:1783947682.813629:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214089088 00000100:00100000:1.0:1783947682.813637:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00100000:3.0:1783947682.813644:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088448 00000100:00100000:2.0:1783947682.813645:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1783947682.813646:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088448 00000100:00100000:2.0:1783947682.813656:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2409:x1870604214088704:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947682.813659:0:19073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604214088960 00000100:00100000:3.0:1783947682.813661:0:19073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604214088960 00000100:00100000:3.0:1783947682.813672:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:3.0:1783947682.813676:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+8:2409:x1870604214088576:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947682.813682:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+6:2409:x1870604214088704:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947682.813688:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 69 00000100:00100000:3.0:1783947682.813698:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+8:2409:x1870604214088576:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 21us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.813704:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 29 00000100:00100000:2.0:1783947682.813707:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1783947682.813713:0:19073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1783947682.813713:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214089088:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:3.0:1783947682.813724:0:19073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2409:x1870604214088448:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947682.813734:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214089088:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947682.813740:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 30 00000100:00100000:3.0:1783947682.813743:0:19073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+5:2409:x1870604214088448:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 20us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947682.813748:0:19073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 31 00000100:00100000:2.0:1783947682.813751:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:2.0:1783947682.813757:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214088960:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:2.0:1783947682.813779:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac76b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:497e6a87-8b91-43fa-9ee3-bdf0bfe7a84e+5:2409:x1870604214088960:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 22us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783947682.813785:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 32 00000100:00100000:1.0:1783947682.814791:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7be3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+26:2409:x1870604214088192:12345-192.168.204.3@tcp:400:kworker.0 00000100:00100000:1.0:1783947682.815478:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7be3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc51fa7f-2744-43d7-9883-dba4b4b8d1ba+26:2409:x1870604214088192:12345-192.168.204.3@tcp:400:kworker.0 Request processed in 1810us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947682.815488:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.3@tcp, seq: 68 00000100:00080000:1.0:1783947682.815523:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783947682.815528:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783947682.815531:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783947682.815534:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1783947682.843815:0:20277:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1783947683.572739:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783947684.089289:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236180992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947684.089358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947684.089477:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783947684.089485:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236180864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783947684.089513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783947684.089554:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236180992 00000100:00100000:3.0:1783947684.089562:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236180992 00000100:00100000:3.0:1783947684.089737:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947684.089748:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236180992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783947684.089780:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947684.089826:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1870604236180992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947684.089834:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783947684.090052:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7bf7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1870604236180992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783947684.090101:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236180864 00000100:00100000:3.0:1783947684.090106:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236180864 00000100:00100000:3.0:1783947684.090142:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947684.090149:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236180864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783947684.090175:0:17092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783947684.090231:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7bf7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1870604236180864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947684.090254:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783947684.090285:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac85eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1870604236180864:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1783947684.090351:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947684.090588:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236180736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783947684.090621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947684.090677:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783947684.090695:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9e7ac7e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236181120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783947684.090717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783947684.090740:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236181120 00000100:00100000:1.0:1783947684.090743:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236181120 00000100:00100000:1.0:1783947684.090767:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947684.090773:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236181120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783947684.090792:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1783947684.090823:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1870604236181120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1783947684.090829:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783947684.090855:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1870604236181120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783947684.091030:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870604236180736 00000100:00100000:3.0:1783947684.091035:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870604236180736 00000100:00100000:3.0:1783947684.091067:0:18596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783947684.091074:0:18596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236180736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783947684.091085:0:18596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783947684.091116:0:18596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e7ac7e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1870604236180736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783947684.091122:0:18596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1783947684.091281:0:17083:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783947684.091305:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9e7ac7e80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1870604236180736:0@lo:13:osp-pre-0-0.0 Debug log: 42925 lines, 42925 kept, 0 dropped, 0 bad.